-- Logs begin at Fri 2022-04-29 19:11:23 UTC, end at Fri 2022-04-29 20:30:55 UTC. -- Apr 29 19:58:54.497924 dv-osbrick-836391-8-ceph systemd[1]: Starting Devstack devstack@keystone.service... Apr 29 19:58:54.506676 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 29 19:58:54.508715 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 29 19:58:54 2022] *** Apr 29 19:58:54.508715 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 29 19:58:54.508715 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 29 19:58:54.508715 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: nodename: dv-osbrick-836391-8-ceph Apr 29 19:58:54.508715 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: machine: x86_64 Apr 29 19:58:54.508715 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: clock source: unix Apr 29 19:58:54.508715 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: pcre jit disabled Apr 29 19:58:54.508715 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: detected number of CPU cores: 4 Apr 29 19:58:54.508715 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: current working directory: / Apr 29 19:58:54.508715 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: detected binary path: /usr/bin/uwsgi-core Apr 29 19:58:54.508715 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: your processes number limit is 47680 Apr 29 19:58:54.509414 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: your memory page size is 4096 bytes Apr 29 19:58:54.509414 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: detected max file descriptor number: 2048 Apr 29 19:58:54.509414 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: lock engine: pthread robust mutexes Apr 29 19:58:54.509414 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: thunder lock: enabled Apr 29 19:58:54.509414 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 29 19:58:54.509414 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 29 19:58:54.560754 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: Python main interpreter initialized at 0x565358ed29c0 Apr 29 19:58:54.560754 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: python threads support enabled Apr 29 19:58:54.560754 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: your server socket listen backlog is limited to 100 connections Apr 29 19:58:54.560754 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: your mercy for graceful operations on workers is 90 seconds Apr 29 19:58:54.561155 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: mapped 403077 bytes (393 KB) for 2 cores Apr 29 19:58:54.561231 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: *** Operational MODE: preforking *** Apr 29 19:58:54.561484 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: *** uWSGI is running in multiple interpreter mode *** Apr 29 19:58:54.561484 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: spawned uWSGI master process (pid: 87048) Apr 29 19:58:54.561700 dv-osbrick-836391-8-ceph systemd[1]: Started Devstack devstack@keystone.service. Apr 29 19:58:54.563272 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: spawned uWSGI worker 1 (pid: 87059, cores: 1) Apr 29 19:58:54.563272 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: spawned uWSGI worker 2 (pid: 87060, cores: 1) Apr 29 19:58:54.563272 dv-osbrick-836391-8-ceph devstack@keystone.service[87048]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 29 19:59:00.417004 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 19:59:00.417004 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: from cryptography.utils import int_from_bytes Apr 29 19:59:00.417746 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 19:59:00.417746 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: from cryptography.utils import int_from_bytes Apr 29 19:59:00.450231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 19:59:00.450231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: from cryptography.utils import int_from_bytes Apr 29 19:59:00.450727 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 29 19:59:00.450727 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: from cryptography.utils import int_from_bytes Apr 29 19:59:00.466991 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 29 19:59:00.467190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 29 19:59:00.467382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] command line args: [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 29 19:59:00.467653 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 29 19:59:00.467830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ================================================================================ {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 29 19:59:00.468117 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] admin_token = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.468366 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] config_dir = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.468554 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.468736 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] config_source = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.468917 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] debug = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.469116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.469602 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.469694 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.469912 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.470165 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.470399 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] list_limit = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.470582 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] log_config_append = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.470762 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.470987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] log_dir = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.471117 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] log_file = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.471356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.471607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.471856 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.472135 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.472316 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.472495 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.472743 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.472991 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.473228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.473465 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.473698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.473934 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.474181 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.474431 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.474706 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.475192 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.475377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] publish_errors = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.475612 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.475842 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.476045 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.476295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.476533 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.476768 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] standard_threads = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.476999 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.477244 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.477422 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.477600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] use_journal = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.477777 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] use_json = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.477954 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] use_stderr = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.478151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] use_syslog = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.478389 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.478646 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.478884 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.479146 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.479391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.479649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.479891 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.480167 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.480449 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.480652 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.481156 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.481413 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.481647 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.481895 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.482129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.482378 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.482627 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.482867 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.483124 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.483378 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.483625 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.483861 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.484143 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.484406 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.484660 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.484912 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.485145 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.485376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.485608 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.485843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.486093 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.486344 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.486576 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.486809 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.487056 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.487306 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.487548 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.487801 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.488057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.488298 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.488535 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.488767 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.488999 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.489232 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.489469 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.489707 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.489957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.490188 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.490428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.490660 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.490896 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.491133 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.491384 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.491616 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.491855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.492116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.492356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.492593 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.492831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.493061 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.493313 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.493548 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.494300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.494537 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.494800 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.495039 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.495272 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.495512 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.495751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.496041 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.496286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.496537 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.496786 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.496958 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 29 19:59:00.497041 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.497113 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 29 19:59:00.497217 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] command line args: [] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 29 19:59:00.497300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.497470 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.497555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 29 19:59:00.497650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ================================================================================ {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 29 19:59:00.497726 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.497912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] admin_token = **** {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.497989 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.498159 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] config_dir = [] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.498248 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.498347 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.498424 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.498527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] config_source = [] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.498630 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.498709 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] debug = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.498872 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.498957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.499110 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.499259 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.499336 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.499414 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.499521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.499600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.499767 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.499844 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.500020 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] list_limit = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.500121 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.500196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] log_config_append = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.500325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.500411 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.500529 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] log_dir = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.500616 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.500702 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] log_file = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.500883 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.501017 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.501161 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.501294 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.501426 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.501557 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.501687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.501770 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.501843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.501912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.501991 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.502068 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.502140 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.502240 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.502320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.502398 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.502557 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.502641 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.502799 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.502880 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.503036 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.503115 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.503262 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.503347 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.503503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.503582 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.503745 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.503823 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.504122 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.504212 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.504299 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.504497 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] auth.external = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.504584 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.504683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] publish_errors = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.504768 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.504915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.505029 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.505143 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.505266 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.505354 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.505501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] auth.password = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.505580 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.505734 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] auth.token = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.505812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.505975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.506063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] standard_threads = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.506203 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.506280 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.506444 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.506528 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.506602 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.506680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.506780 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] use_journal = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.506912 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.506991 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] use_json = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.507112 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] use_stderr = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.507188 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.507268 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] use_syslog = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.507380 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.507504 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 29 19:59:00.507617 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] credential.caching = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.507746 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.507868 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.508008 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.508144 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.508256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.508396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.508493 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.508654 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.508730 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.508871 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.508951 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.509108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.509187 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.509388 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.510075 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.510186 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.510275 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.510428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.510507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.510674 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.510759 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.510908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.510986 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.511153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.511239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.511388 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.511473 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.511634 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.511717 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.511879 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.511966 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.512145 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.512226 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] federation.caching = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.512401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.512480 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.512651 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.512730 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.512891 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.512968 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.513124 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.513203 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.513372 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.513450 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.513610 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.513696 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.513867 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.513946 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.514113 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.514235 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.514345 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.514429 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.514562 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.514677 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.514777 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.514897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.515008 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.515137 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity.caching = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.515262 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.515392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.515511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.515643 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.515741 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.515881 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.515962 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.516144 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.516225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.516396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.516487 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.516631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.516712 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.516870 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.516949 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.517123 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.517202 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.517365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.517443 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.517599 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.517677 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.517827 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.517905 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.518056 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.518136 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.518284 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.518370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.518541 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.518618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.518800 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.518957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.519061 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.519207 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.519328 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.519514 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.519600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.519753 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.519831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.519997 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.520092 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.520313 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.520430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.520556 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.520676 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.520789 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.521002 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.521081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.521237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.521316 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.521474 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.521561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.521709 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.521832 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.521951 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.522028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.522193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.522273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.522445 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.522618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.522709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.522848 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.522960 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.523130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.523212 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.523362 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.523442 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.523597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.523751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.523828 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.523901 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.524082 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.524164 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.524319 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.524410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.524548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.524628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.524782 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.524861 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.525015 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.525104 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.525320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.525408 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.525554 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.525632 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.525792 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.525879 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.526025 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.526105 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.526257 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.526335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.526488 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.526576 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.526721 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.526800 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.526966 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.527046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.527201 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.527290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.527431 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.527510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.527670 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.527748 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.527906 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.528036 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.528166 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.528247 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.528399 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.528479 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.528630 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.528719 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.528862 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.528942 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.529113 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.529192 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.529350 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.529437 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.529586 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.529665 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.529818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.529903 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.530055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.530135 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.530287 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.530365 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.530520 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.530600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.530754 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.530835 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.530981 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.531060 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.531212 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.531291 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.531440 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.531526 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.531673 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.531753 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.531910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.532009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.532175 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.532258 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.532421 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.532499 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.532661 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.532740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.532897 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.532977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.533142 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.533220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.533394 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.533473 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.533630 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.533710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.533860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] auth.external = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.533940 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.534089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.534177 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.534337 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.534417 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.534576 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.534656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.534813 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.534900 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] auth.password = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.535039 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] auth.token = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.535119 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.535274 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.535354 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.535507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.535591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.535742 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.535822 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.535966 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.536104 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.536230 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] resource.caching = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.536309 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.536473 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.536553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.536700 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.536779 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.536933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] credential.caching = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.537011 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.537178 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.537258 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.537425 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.537505 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.537662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.537740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.537893 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.537978 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.538133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.538212 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.538364 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.538443 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.538599 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] role.caching = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.538685 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.538849 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] role.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.538929 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.539083 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.539162 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.539332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.539412 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.539582 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.539661 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.539835 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.539914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.540109 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.540193 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.540348 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.540426 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.540596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.540675 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.540907 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] federation.caching = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.540987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.541148 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.541227 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.541392 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.541471 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.541637 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.541718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.541865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.541944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.542110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.542197 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.542342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.542422 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.542592 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.542765 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.542844 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.543006 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.543094 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.543258 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.543341 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.543512 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.543592 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.543742 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity.caching = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.543822 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.544038 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.544171 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.544249 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.544332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.544479 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.544559 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.544709 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.544789 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.544957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.545036 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.545186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.545266 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.545421 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.545499 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.545657 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.545737 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.545904 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.545984 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.546134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.546213 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.546359 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.546438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.546585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.546665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.546823 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.546903 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.547068 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.547148 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.547306 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] token.caching = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.547385 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.547546 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.547625 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.547787 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.547865 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.548048 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.548129 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.548310 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.548390 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.548542 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.548620 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.548770 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.548851 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.549002 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.549081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.549229 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.549307 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.549462 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.549542 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.549698 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.549778 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.549935 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.550024 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.550172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.550250 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.550398 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.550482 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.550644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.550732 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.550878 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.550956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.551115 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.551193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.551370 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.551457 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.551618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.551697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.connection = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.551845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.551933 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.552105 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.552186 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.552335 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.552430 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.552569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.552649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.552802 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.552880 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.553038 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.553125 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.553270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.553349 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.553502 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.553581 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.553746 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.553833 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.553984 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.554065 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.554209 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.554287 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.554435 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.554523 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.554680 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.554759 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.554916 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.554994 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.555146 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.555235 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.555378 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.555457 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.555608 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.555687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.555834 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.555922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.556015 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 29 19:59:00.556090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.556863 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.557092 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.557337 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.557581 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.557832 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.558063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.558289 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.558520 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.558750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.558982 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.559210 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.559454 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.559696 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.559939 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.560207 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.560450 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.560681 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.560924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.561157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.561390 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.561622 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.561856 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.562097 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.562342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.562577 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.562829 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.563057 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.563296 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.563528 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.563758 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.564020 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.564256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.564494 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.564724 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.564957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.565193 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] resource.caching = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.565441 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.565688 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.565920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.566166 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.566413 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.566645 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.566889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.567123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.567357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.567586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] role.caching = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.567831 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] role.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.568081 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.568329 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.568574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.568819 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.569061 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.569304 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.569546 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.569789 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.570034 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.570262 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.570521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.570766 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.571012 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.571255 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.571664 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.571917 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.572726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.572976 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.573225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.573470 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.573702 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.573952 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.574199 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.574437 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.574666 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.574896 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.575124 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.575373 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.575630 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.575877 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.576133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.576369 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.576595 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.576827 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] token.caching = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.577060 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.577305 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.577538 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.577792 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.578037 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.578272 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.578514 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.578752 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.578996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.579230 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.579465 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.579696 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.579940 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.580210 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.580442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.580681 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.580970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.581230 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.connection = **** {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.581473 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.581719 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.581953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.582189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.582420 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.582651 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.582882 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.583113 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.583354 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.583586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.583827 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.584081 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.584329 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.584561 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.584813 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.585042 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.585280 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.585785 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 29 19:59:00.585962 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 29 19:59:00.587660 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.587896 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.588147 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.596711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.612394 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.612625 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.612850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.621826 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.625650 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.625885 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.640531 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.640759 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.678059 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.683265 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.729548 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.729784 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.731103 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.731336 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.795865 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.796037 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.796144 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.796263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.796348 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.796486 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.796570 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.796705 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.796789 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.796923 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.797006 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.797139 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.823033 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.823155 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.823265 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.823349 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.823484 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.823566 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.823701 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.823786 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.823915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.824032 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.824152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.824250 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.824366 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.824447 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.835460 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.835634 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.848252 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.848412 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.848500 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.848640 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.848724 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.848859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.848944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.849073 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.849156 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.849282 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.849366 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.849490 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.849582 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87060) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.849698 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 29 19:59:00.867435 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.867647 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 29 19:59:00.867860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.867997 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.868083 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 29 19:59:00.868209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 29 19:59:00.868406 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.868489 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.868605 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 29 19:59:00.868721 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.869401 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.869526 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.869667 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.869783 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.869919 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.870169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.880765 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.880998 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.881082 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.881267 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.881350 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.881531 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.881614 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.881806 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.889713 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.890145 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.893036 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.893319 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.893427 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.893610 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.893693 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.893887 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.893969 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.894171 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.894254 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.894432 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.894515 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.894700 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.894781 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.894958 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.895047 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.895221 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.895335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.895588 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.895669 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.895856 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.895939 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.897166 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.922806 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.922951 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.924454 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.924557 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.924735 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.924819 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.930120 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.930212 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.930404 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.930487 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.930684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.930767 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.938481 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.938588 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.938758 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.938842 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.943205 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.943290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.943486 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.943571 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.943762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.943845 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.944059 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.944144 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.944433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.944519 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.944704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.944796 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.944966 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.945055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.945228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.945309 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.965600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.965711 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.966004 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.966159 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.971873 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.972915 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.975467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.975756 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.976576 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.976874 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.981628 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.983044 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.985338 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.986721 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:00.989044 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.989339 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.989872 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.990265 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.990434 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.990527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.990732 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.990854 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.991017 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.991415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.991697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:00.992045 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.010221 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.010497 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.010756 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.011020 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.011561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.011849 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.012151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.012419 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.018942 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.020550 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.020723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.020990 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.022262 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.022536 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.024037 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.024316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.024593 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.024869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.025174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.025671 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.025954 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.026236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.026518 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.026792 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.038602 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.038878 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.039153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.039426 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.039697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.039961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.040249 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.040388 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.041202 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.041489 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.041771 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.042055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.042338 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.042612 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.059132 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.061137 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.062496 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.064558 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.065813 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.067391 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.067864 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.069043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.069317 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.069504 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.069587 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.071156 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.071436 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.071714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.078050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.079657 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.080304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.081942 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.082850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.083133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.083409 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.083678 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.085214 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.085532 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.085833 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.086381 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.093324 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.093607 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.093883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.095554 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.095840 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.096147 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.101877 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.102082 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.102353 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.102620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.102884 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.103669 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.103941 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.104250 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.104539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.104715 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87060) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 29 19:59:01.104813 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.105001 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.105083 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.105291 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.105412 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.105568 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.105659 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.106093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.106198 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.106362 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.106644 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.106929 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.107215 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.107492 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.107763 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.108047 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.111850 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.111850 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87060) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 29 19:59:01.144599 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x565358ed29c0 pid: 87059 (default app) Apr 29 19:59:01.146861 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x565358ed29c0 pid: 87060 (default app) Apr 29 19:59:01.147892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6321a-a9e5-40b9-895b-51c5a99c0ef8 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:01.148201 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6321a-a9e5-40b9-895b-51c5a99c0ef8 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:01.148471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6321a-a9e5-40b9-895b-51c5a99c0ef8 None None] PATH_INFO: `/v3` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:01.153640 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Fri Apr 29 19:59:01 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:10.396805 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeee4ee-5c5f-43f8-a365-3117e21ec95d None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:10.397361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeee4ee-5c5f-43f8-a365-3117e21ec95d None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:10.397361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeee4ee-5c5f-43f8-a365-3117e21ec95d None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:10.402309 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:10.407691 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be356b67-3e70-49e7-8494-d9dfb4b28b1f None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:10.408116 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be356b67-3e70-49e7-8494-d9dfb4b28b1f None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:10.408257 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be356b67-3e70-49e7-8494-d9dfb4b28b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:10.437736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG oslo_db.sqlalchemy.engines [None req-be356b67-3e70-49e7-8494-d9dfb4b28b1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 19:59:10.619475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG passlib.handlers.bcrypt [None req-be356b67-3e70-49e7-8494-d9dfb4b28b1f None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=87059) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 29 19:59:10.619811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG passlib.handlers.bcrypt [None req-be356b67-3e70-49e7-8494-d9dfb4b28b1f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87059) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 29 19:59:10.674666 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-be356b67-3e70-49e7-8494-d9dfb4b28b1f None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:10.676286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-be356b67-3e70-49e7-8494-d9dfb4b28b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:10.797208 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 29 19:59:10.960037 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeee4ee-5c5f-43f8-a365-3117e21ec95d None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:10.995155 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG oslo_db.sqlalchemy.engines [None req-eeeee4ee-5c5f-43f8-a365-3117e21ec95d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 29 19:59:11.122921 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeee4ee-5c5f-43f8-a365-3117e21ec95d None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:11.127117 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b919e-6385-440f-9dc1-1e809194c029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:11.127763 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b919e-6385-440f-9dc1-1e809194c029 admin admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:11.128067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b919e-6385-440f-9dc1-1e809194c029 admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:11.128342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b919e-6385-440f-9dc1-1e809194c029 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:11.136230 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b919e-6385-440f-9dc1-1e809194c029 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:11.186982 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: WARNING keystone.common.rbac_enforcer.enforcer [None req-277b919e-6385-440f-9dc1-1e809194c029 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 29 19:59:11.187318 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b919e-6385-440f-9dc1-1e809194c029 admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:11.196489 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1324 bytes} [Fri Apr 29 19:59:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 19:59:11.202360 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be356b67-3e70-49e7-8494-d9dfb4b28b1f None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:11.217045 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be356b67-3e70-49e7-8494-d9dfb4b28b1f None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:11.221407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ba6ca-b886-4ab0-950b-98c2084c83ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:11.222653 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ba6ca-b886-4ab0-950b-98c2084c83ac admin admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:11.223005 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ba6ca-b886-4ab0-950b-98c2084c83ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:11.223346 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ba6ca-b886-4ab0-950b-98c2084c83ac admin admin] PATH_INFO: `/v3/projects/1e417b1278554b3d876c18d3b8c537fa` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:11.225012 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ba6ca-b886-4ab0-950b-98c2084c83ac admin admin] RBAC: Authorizing `identity:get_project(project_id=1e417b1278554b3d876c18d3b8c537fa)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:11.277124 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8c1ba6ca-b886-4ab0-950b-98c2084c83ac admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 29 19:59:11.277468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ba6ca-b886-4ab0-950b-98c2084c83ac admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:11.282115 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 3/5] 10.222.0.58 () {56 vars in 1207 bytes} [Fri Apr 29 19:59:11 2022] GET /identity/v3/projects/1e417b1278554b3d876c18d3b8c537fa => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:13.576257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e1f84-1459-449a-ad36-d2f5b11163ab None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:13.576790 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e1f84-1459-449a-ad36-d2f5b11163ab None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:13.576790 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e1f84-1459-449a-ad36-d2f5b11163ab None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:13.580916 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 3/6] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 19:59:13.586341 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eefea5-d02c-4fef-8bfd-0539638ed1f8 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:13.586770 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eefea5-d02c-4fef-8bfd-0539638ed1f8 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:13.586891 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eefea5-d02c-4fef-8bfd-0539638ed1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:13.605900 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-84eefea5-d02c-4fef-8bfd-0539638ed1f8 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:13.607362 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-84eefea5-d02c-4fef-8bfd-0539638ed1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:13.615157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 29 19:59:13.638653 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e1f84-1459-449a-ad36-d2f5b11163ab None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:13.650783 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e1f84-1459-449a-ad36-d2f5b11163ab None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:13.654960 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc2aa1-451b-44de-89bf-7119d5889043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:13.655574 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc2aa1-451b-44de-89bf-7119d5889043 admin admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:13.655854 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc2aa1-451b-44de-89bf-7119d5889043 admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:13.656163 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc2aa1-451b-44de-89bf-7119d5889043 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:13.663611 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc2aa1-451b-44de-89bf-7119d5889043 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:13.665925 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc2aa1-451b-44de-89bf-7119d5889043 admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:13.674573 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1324 bytes} [Fri Apr 29 19:59:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 29 19:59:13.679730 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eefea5-d02c-4fef-8bfd-0539638ed1f8 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:13.689044 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eefea5-d02c-4fef-8bfd-0539638ed1f8 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:13.693325 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb6f0e-82ae-4ef3-9a55-28862bc25000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:13.694171 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb6f0e-82ae-4ef3-9a55-28862bc25000 admin admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:13.694446 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb6f0e-82ae-4ef3-9a55-28862bc25000 admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:13.694713 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb6f0e-82ae-4ef3-9a55-28862bc25000 admin admin] PATH_INFO: `/v3/users/60cf68d8163c4e1192fe62342bc80660` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:13.696132 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb6f0e-82ae-4ef3-9a55-28862bc25000 admin admin] RBAC: Authorizing `identity:get_user(user_id=60cf68d8163c4e1192fe62342bc80660)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:13.698054 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb6f0e-82ae-4ef3-9a55-28862bc25000 admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:13.700050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 5/9] 10.222.0.58 () {56 vars in 1198 bytes} [Fri Apr 29 19:59:13 2022] GET /identity/v3/users/60cf68d8163c4e1192fe62342bc80660 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:16.070845 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7de29-1d50-485f-9306-df5e9aed0ed3 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:16.071904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7de29-1d50-485f-9306-df5e9aed0ed3 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:16.071904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7de29-1d50-485f-9306-df5e9aed0ed3 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:16.073586 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:16.078692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621853a-9749-4dbb-91c7-dcdf359a5eeb None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:16.079095 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621853a-9749-4dbb-91c7-dcdf359a5eeb None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:16.079388 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621853a-9749-4dbb-91c7-dcdf359a5eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:16.079779 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049906a-2c41-4dbe-9244-d6f2eb2f9812 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:16.080102 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049906a-2c41-4dbe-9244-d6f2eb2f9812 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:16.080386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049906a-2c41-4dbe-9244-d6f2eb2f9812 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:16.081634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 6/11] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 19:59:16.086766 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce491107-c454-4295-b739-b80a10028d0b None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:16.087137 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce491107-c454-4295-b739-b80a10028d0b None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:16.087905 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce491107-c454-4295-b739-b80a10028d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:16.097718 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-8621853a-9749-4dbb-91c7-dcdf359a5eeb None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:16.098902 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-8621853a-9749-4dbb-91c7-dcdf359a5eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:16.129839 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG passlib.handlers.bcrypt [None req-ce491107-c454-4295-b739-b80a10028d0b None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=87060) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 29 19:59:16.130274 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG passlib.handlers.bcrypt [None req-ce491107-c454-4295-b739-b80a10028d0b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87060) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 29 19:59:16.177377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 6/12] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:16.177615 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-ce491107-c454-4295-b739-b80a10028d0b None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:16.179319 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-ce491107-c454-4295-b739-b80a10028d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:16.201550 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621853a-9749-4dbb-91c7-dcdf359a5eeb None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:16.276737 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:16.298015 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621853a-9749-4dbb-91c7-dcdf359a5eeb None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:16.300209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce491107-c454-4295-b739-b80a10028d0b None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:16.329830 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63431332-fccd-4124-be48-5156196049ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:16.330556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63431332-fccd-4124-be48-5156196049ff None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:16.330844 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63431332-fccd-4124-be48-5156196049ff None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:16.331122 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63431332-fccd-4124-be48-5156196049ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:16.344258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63431332-fccd-4124-be48-5156196049ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-63431332-fccd-4124-be48-5156196049ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:16.356459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:16.357552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:16.358512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:16.358512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:16.358512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:16.358512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:16.358512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:16.358512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:16.358512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:16.358512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:16.358512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:16.358512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:16.358512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:16.358512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 19:59:16.358512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 7/14] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 19:59:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 19:59:16.363299 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63431332-fccd-4124-be48-5156196049ff None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:16.399128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce491107-c454-4295-b739-b80a10028d0b None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:16.431576 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7728414-1bf3-4280-bb74-50936461df54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:16.432479 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7728414-1bf3-4280-bb74-50936461df54 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:16.432770 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7728414-1bf3-4280-bb74-50936461df54 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:16.433050 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7728414-1bf3-4280-bb74-50936461df54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:16.454762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63431332-fccd-4124-be48-5156196049ff None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:16.487629 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcd98e-0522-4cec-a6d8-7aaaa9b98d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:16.488305 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd98e-0522-4cec-a6d8-7aaaa9b98d44 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:16.488583 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd98e-0522-4cec-a6d8-7aaaa9b98d44 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:16.488851 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd98e-0522-4cec-a6d8-7aaaa9b98d44 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:16.489585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcd98e-0522-4cec-a6d8-7aaaa9b98d44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:16.489884 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcd98e-0522-4cec-a6d8-7aaaa9b98d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:16.491274 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcd98e-0522-4cec-a6d8-7aaaa9b98d44 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:16.498398 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7728414-1bf3-4280-bb74-50936461df54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:16.499902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7728414-1bf3-4280-bb74-50936461df54 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:16.503596 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 8/15] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:16.509513 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcd98e-0522-4cec-a6d8-7aaaa9b98d44 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:16.710137 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 8/16] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 29 19:59:16.711179 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7728414-1bf3-4280-bb74-50936461df54 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:16.720581 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcd98e-0522-4cec-a6d8-7aaaa9b98d44 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:16.757155 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3f3d5-df1e-47ae-95ee-712fd4d46dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:16.758024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3f3d5-df1e-47ae-95ee-712fd4d46dd8 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:16.758301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3f3d5-df1e-47ae-95ee-712fd4d46dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:16.758570 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3f3d5-df1e-47ae-95ee-712fd4d46dd8 None admin] PATH_INFO: `/v3/users/60cf68d8163c4e1192fe62342bc80660` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:16.760633 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3f3d5-df1e-47ae-95ee-712fd4d46dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=60cf68d8163c4e1192fe62342bc80660)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:16.762095 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3f3d5-df1e-47ae-95ee-712fd4d46dd8 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:16.763720 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 9/17] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:16 2022] GET /identity/v3/users/60cf68d8163c4e1192fe62342bc80660 => generated 247 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:16.768987 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3f3d5-df1e-47ae-95ee-712fd4d46dd8 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:16.807653 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7728414-1bf3-4280-bb74-50936461df54 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:16.839152 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb227f8b-5242-4390-94f3-27da9d72bf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:16.839934 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb227f8b-5242-4390-94f3-27da9d72bf5c None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:16.840249 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb227f8b-5242-4390-94f3-27da9d72bf5c None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:16.840532 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb227f8b-5242-4390-94f3-27da9d72bf5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:16.859300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb227f8b-5242-4390-94f3-27da9d72bf5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:16.860806 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb227f8b-5242-4390-94f3-27da9d72bf5c None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:16.862316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3f3d5-df1e-47ae-95ee-712fd4d46dd8 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:16.881346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-bb227f8b-5242-4390-94f3-27da9d72bf5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 19:59:16.881346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:16.881346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:16.881346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:16.881346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:16.881346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:16.881346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:16.881346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:16.881346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:16.881346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:16.881346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:16.881346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:16.881346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 19:59:16.881346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 19:59:16.881346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:16.882361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:16.883376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 19:59:16.883376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 19:59:16.883376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 19:59:16.883376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:16.883376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 9/18] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 19:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:16.888532 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb227f8b-5242-4390-94f3-27da9d72bf5c None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:16.895911 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88511b3-2686-4dc7-bb66-2eb2e471ed98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:16.896734 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88511b3-2686-4dc7-bb66-2eb2e471ed98 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:16.897010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88511b3-2686-4dc7-bb66-2eb2e471ed98 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:16.897278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88511b3-2686-4dc7-bb66-2eb2e471ed98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:16.898449 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88511b3-2686-4dc7-bb66-2eb2e471ed98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:16.900465 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88511b3-2686-4dc7-bb66-2eb2e471ed98 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:16.902067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 10/19] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 19:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:16.907599 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88511b3-2686-4dc7-bb66-2eb2e471ed98 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:16.989086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb227f8b-5242-4390-94f3-27da9d72bf5c None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:17.001169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88511b3-2686-4dc7-bb66-2eb2e471ed98 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:17.015676 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992646f-2d29-43d6-afb0-9be84aee7554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:17.016370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992646f-2d29-43d6-afb0-9be84aee7554 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:17.016650 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992646f-2d29-43d6-afb0-9be84aee7554 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:17.016937 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992646f-2d29-43d6-afb0-9be84aee7554 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:17.017653 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992646f-2d29-43d6-afb0-9be84aee7554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:17.017959 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992646f-2d29-43d6-afb0-9be84aee7554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:17.019352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992646f-2d29-43d6-afb0-9be84aee7554 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:17.039027 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 10/20] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 19:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:17.040977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe27fc-8772-4f18-b816-ba6afbb86f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:17.041654 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe27fc-8772-4f18-b816-ba6afbb86f3a None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:17.041940 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe27fc-8772-4f18-b816-ba6afbb86f3a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:17.042218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe27fc-8772-4f18-b816-ba6afbb86f3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:17.043136 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe27fc-8772-4f18-b816-ba6afbb86f3a None admin] RBAC: Adding query filter params (role.id=5255ed3fa613448fb4c549f5bc7f20af, scope.domain.id=default, user.id=60cf68d8163c4e1192fe62342bc80660) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:17.043442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe27fc-8772-4f18-b816-ba6afbb86f3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:17.044975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe27fc-8772-4f18-b816-ba6afbb86f3a None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:17.052908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 11/21] 10.222.0.58 () {56 vars in 1322 bytes} [Fri Apr 29 19:59:16 2022] GET /identity/v3/role_assignments?user.id=60cf68d8163c4e1192fe62342bc80660&scope.domain.id=default&role.id=5255ed3fa613448fb4c549f5bc7f20af => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:19.554159 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe26710-a1dd-410a-afb0-f028a458504a None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:19.554694 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe26710-a1dd-410a-afb0-f028a458504a None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:19.554694 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe26710-a1dd-410a-afb0-f028a458504a None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:19.556352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 11/22] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:19.561821 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb1999-b3df-4aa1-bc9e-6dbb032715c9 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:19.562654 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb1999-b3df-4aa1-bc9e-6dbb032715c9 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:19.563152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb1999-b3df-4aa1-bc9e-6dbb032715c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:19.583928 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-fbcb1999-b3df-4aa1-bc9e-6dbb032715c9 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:19.585448 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-fbcb1999-b3df-4aa1-bc9e-6dbb032715c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:19.681993 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 12/23] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:19.725508 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe26710-a1dd-410a-afb0-f028a458504a None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:19.859213 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe26710-a1dd-410a-afb0-f028a458504a None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:19.905063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247bf3a-e027-471a-9461-71ceaf7da98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:19.905861 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247bf3a-e027-471a-9461-71ceaf7da98c None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:19.906136 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247bf3a-e027-471a-9461-71ceaf7da98c None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:19.906406 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247bf3a-e027-471a-9461-71ceaf7da98c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:19.926707 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247bf3a-e027-471a-9461-71ceaf7da98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-0247bf3a-e027-471a-9461-71ceaf7da98c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:19.936356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:19.937190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:19.937960 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:19.937960 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:19.937960 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:19.937960 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:19.937960 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:19.937960 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:19.937960 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:19.937960 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:19.937960 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:19.937960 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:19.937960 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:19.937960 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:19.937960 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 12/24] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 19:59:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:19.949095 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb1999-b3df-4aa1-bc9e-6dbb032715c9 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:19.966402 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bcafa-23ca-4e44-876b-c101d6d67f13 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:19.967003 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bcafa-23ca-4e44-876b-c101d6d67f13 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:19.967482 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bcafa-23ca-4e44-876b-c101d6d67f13 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:19.969410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 13/25] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:19.985702 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b10d6-67c7-44d3-84a5-eb257522fa08 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:19.986322 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b10d6-67c7-44d3-84a5-eb257522fa08 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:19.986803 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b10d6-67c7-44d3-84a5-eb257522fa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:20.017186 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-013b10d6-67c7-44d3-84a5-eb257522fa08 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:20.018736 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-013b10d6-67c7-44d3-84a5-eb257522fa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:20.056924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb1999-b3df-4aa1-bc9e-6dbb032715c9 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:20.097257 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0f11a-1b24-45c0-9f58-9a5cb23f7f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:20.098872 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0f11a-1b24-45c0-9f58-9a5cb23f7f0f None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:20.099186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0f11a-1b24-45c0-9f58-9a5cb23f7f0f None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:20.099471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0f11a-1b24-45c0-9f58-9a5cb23f7f0f None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:20.100271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0f11a-1b24-45c0-9f58-9a5cb23f7f0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:20.100583 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0f11a-1b24-45c0-9f58-9a5cb23f7f0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:20.102001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0f11a-1b24-45c0-9f58-9a5cb23f7f0f None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:20.112991 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 13/26] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:20.114738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c661bb-cfa8-47c2-a6e1-95b0da4d699f None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:20.115028 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c661bb-cfa8-47c2-a6e1-95b0da4d699f None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:20.115308 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c661bb-cfa8-47c2-a6e1-95b0da4d699f None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:20.121536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 14/27] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:20.123659 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c661bb-cfa8-47c2-a6e1-95b0da4d699f None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:20.148476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 14/28] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:20.151965 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4681d1f-c307-47d3-b150-7637744eae29 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:20.152709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4681d1f-c307-47d3-b150-7637744eae29 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:20.153373 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4681d1f-c307-47d3-b150-7637744eae29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:20.179406 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-c4681d1f-c307-47d3-b150-7637744eae29 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:20.181355 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-c4681d1f-c307-47d3-b150-7637744eae29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:20.306044 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c661bb-cfa8-47c2-a6e1-95b0da4d699f None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:20.312426 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 15/29] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:20.313283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4681d1f-c307-47d3-b150-7637744eae29 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:20.392391 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc734fa9-7d2f-4a08-885e-008c025c40ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:20.393673 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734fa9-7d2f-4a08-885e-008c025c40ef None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:20.394213 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734fa9-7d2f-4a08-885e-008c025c40ef None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:20.394661 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734fa9-7d2f-4a08-885e-008c025c40ef None admin] PATH_INFO: `/v3/users/60cf68d8163c4e1192fe62342bc80660` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:20.396086 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc734fa9-7d2f-4a08-885e-008c025c40ef None admin] RBAC: Authorizing `identity:get_user(user_id=60cf68d8163c4e1192fe62342bc80660)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:20.397713 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc734fa9-7d2f-4a08-885e-008c025c40ef None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:20.400530 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 15/30] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:20 2022] GET /identity/v3/users/60cf68d8163c4e1192fe62342bc80660 => generated 247 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:20.401576 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc734fa9-7d2f-4a08-885e-008c025c40ef None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:20.455909 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4681d1f-c307-47d3-b150-7637744eae29 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:20.494592 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb79ff-b48e-49c1-8562-9cc37a71a19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:20.495395 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb79ff-b48e-49c1-8562-9cc37a71a19f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:20.495674 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb79ff-b48e-49c1-8562-9cc37a71a19f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:20.495945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb79ff-b48e-49c1-8562-9cc37a71a19f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:20.512774 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb79ff-b48e-49c1-8562-9cc37a71a19f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:20.515439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb79ff-b48e-49c1-8562-9cc37a71a19f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:20.544964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-62bb79ff-b48e-49c1-8562-9cc37a71a19f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 19:59:20.544964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:20.544964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:20.544964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:20.544964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:20.544964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:20.544964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:20.544964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:20.544964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:20.544964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:20.544964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:20.544964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:20.544964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 19:59:20.544964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 19:59:20.544964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:20.545893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:20.546705 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 19:59:20.546705 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 19:59:20.546705 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 19:59:20.546705 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:20.552636 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 16/31] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 19:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:20.553801 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb79ff-b48e-49c1-8562-9cc37a71a19f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:20.585464 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc734fa9-7d2f-4a08-885e-008c025c40ef None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:20.659691 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f15e7-7cd9-496d-9bc0-322ef425fc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:20.660823 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f15e7-7cd9-496d-9bc0-322ef425fc45 None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:20.661380 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f15e7-7cd9-496d-9bc0-322ef425fc45 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:20.661879 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f15e7-7cd9-496d-9bc0-322ef425fc45 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:20.662835 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f15e7-7cd9-496d-9bc0-322ef425fc45 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:20.664502 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f15e7-7cd9-496d-9bc0-322ef425fc45 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:20.671434 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb79ff-b48e-49c1-8562-9cc37a71a19f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:20.709206 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d977b6-726e-4aad-af21-5fcf94dabbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:20.710018 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d977b6-726e-4aad-af21-5fcf94dabbee None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:20.710333 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d977b6-726e-4aad-af21-5fcf94dabbee None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:20.710601 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d977b6-726e-4aad-af21-5fcf94dabbee None admin] PATH_INFO: `/v3/domains/default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:20.712755 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d977b6-726e-4aad-af21-5fcf94dabbee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:20.714259 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d977b6-726e-4aad-af21-5fcf94dabbee None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:20.716047 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 17/32] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 19:59:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:20.716922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d977b6-726e-4aad-af21-5fcf94dabbee None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:20.824054 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d977b6-726e-4aad-af21-5fcf94dabbee None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:20.869774 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0dd6a-24ec-41ad-8aca-344a5cc08a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:20.870445 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0dd6a-24ec-41ad-8aca-344a5cc08a25 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:20.870725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0dd6a-24ec-41ad-8aca-344a5cc08a25 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:20.871052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0dd6a-24ec-41ad-8aca-344a5cc08a25 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:20.871788 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0dd6a-24ec-41ad-8aca-344a5cc08a25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:20.872116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0dd6a-24ec-41ad-8aca-344a5cc08a25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:20.873545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0dd6a-24ec-41ad-8aca-344a5cc08a25 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:20.895113 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 18/33] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 19:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:20.900659 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0dd6a-24ec-41ad-8aca-344a5cc08a25 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:20.947137 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 16/34] 10.222.0.58 () {60 vars in 1131 bytes} [Fri Apr 29 19:59:20 2022] POST /identity/v3/roles => generated 219 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 19:59:20.948730 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306e019-87f2-482f-adc4-75f8c216235e None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:20.949026 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306e019-87f2-482f-adc4-75f8c216235e None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:20.949307 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306e019-87f2-482f-adc4-75f8c216235e None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:20.955016 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 17/35] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:20.955914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306e019-87f2-482f-adc4-75f8c216235e None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:21.094068 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0dd6a-24ec-41ad-8aca-344a5cc08a25 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:21.119402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306e019-87f2-482f-adc4-75f8c216235e None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:21.178906 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b63424-fc43-41da-b1e8-e466b122b05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:21.179773 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b63424-fc43-41da-b1e8-e466b122b05f None admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:21.180084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b63424-fc43-41da-b1e8-e466b122b05f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:21.180362 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b63424-fc43-41da-b1e8-e466b122b05f None admin] PATH_INFO: `/v3/domains/default/users/60cf68d8163c4e1192fe62342bc80660/roles/5255ed3fa613448fb4c549f5bc7f20af` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:21.183342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b63424-fc43-41da-b1e8-e466b122b05f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=60cf68d8163c4e1192fe62342bc80660, role_id=5255ed3fa613448fb4c549f5bc7f20af)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:21.184900 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b63424-fc43-41da-b1e8-e466b122b05f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:21.190602 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149fb55-31c1-4eac-90dc-40fbc5813c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:21.191582 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149fb55-31c1-4eac-90dc-40fbc5813c9f None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:21.192236 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149fb55-31c1-4eac-90dc-40fbc5813c9f None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:21.192805 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149fb55-31c1-4eac-90dc-40fbc5813c9f None admin] PATH_INFO: `/v3/projects` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:21.193728 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149fb55-31c1-4eac-90dc-40fbc5813c9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:21.195529 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149fb55-31c1-4eac-90dc-40fbc5813c9f None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:21.327965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 18/36] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Apr 29 19:59:20 2022] POST /identity/v3/projects => generated 301 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 19:59:21.329496 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5c682-06fc-4d8e-ba94-e6ccf2c95c99 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:21.329791 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5c682-06fc-4d8e-ba94-e6ccf2c95c99 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:21.330098 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5c682-06fc-4d8e-ba94-e6ccf2c95c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:21.352586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-26b5c682-06fc-4d8e-ba94-e6ccf2c95c99 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:21.352586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-26b5c682-06fc-4d8e-ba94-e6ccf2c95c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:21.420276 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 19/37] 10.222.0.58 () {58 vars in 1361 bytes} [Fri Apr 29 19:59:20 2022] PUT /identity/v3/domains/default/users/60cf68d8163c4e1192fe62342bc80660/roles/5255ed3fa613448fb4c549f5bc7f20af => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 19:59:21.423112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8a05e-b9b1-4068-af9f-60e0d251111b None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:21.423648 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8a05e-b9b1-4068-af9f-60e0d251111b None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:21.424161 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8a05e-b9b1-4068-af9f-60e0d251111b None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:21.428806 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 20/38] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:21.431299 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 19/39] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:21.435728 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8434b-800f-4b02-8b23-d50de114024a None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:21.436372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8434b-800f-4b02-8b23-d50de114024a None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:21.436855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8434b-800f-4b02-8b23-d50de114024a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:21.443381 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c2389-df41-44bb-a2c8-88a243ad522d None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:21.443717 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c2389-df41-44bb-a2c8-88a243ad522d None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:21.444107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c2389-df41-44bb-a2c8-88a243ad522d None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:21.445722 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 20/40] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 19:59:21.454181 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd64589-1fbc-4f50-b986-9cd522eabadb None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:21.454528 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd64589-1fbc-4f50-b986-9cd522eabadb None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:21.454742 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd64589-1fbc-4f50-b986-9cd522eabadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:21.470389 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-bbd8434b-800f-4b02-8b23-d50de114024a None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:21.472308 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-bbd8434b-800f-4b02-8b23-d50de114024a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:21.485282 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-afd64589-1fbc-4f50-b986-9cd522eabadb None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:21.487145 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-afd64589-1fbc-4f50-b986-9cd522eabadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:21.574211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 21/41] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:21.574482 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 21/42] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:21.575806 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8434b-800f-4b02-8b23-d50de114024a None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:21.603720 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd64589-1fbc-4f50-b986-9cd522eabadb None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:21.691520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8434b-800f-4b02-8b23-d50de114024a None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:21.719718 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd64589-1fbc-4f50-b986-9cd522eabadb None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:21.726191 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265e0ec-a5de-43fd-ba1e-daaef78b6ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:21.726865 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265e0ec-a5de-43fd-ba1e-daaef78b6ecd None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:21.727150 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265e0ec-a5de-43fd-ba1e-daaef78b6ecd None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:21.727422 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265e0ec-a5de-43fd-ba1e-daaef78b6ecd None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:21.728769 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265e0ec-a5de-43fd-ba1e-daaef78b6ecd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:21.730552 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265e0ec-a5de-43fd-ba1e-daaef78b6ecd None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:21.754933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6752fb-1e23-4faf-b4ef-d67e836d7d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:21.755729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6752fb-1e23-4faf-b4ef-d67e836d7d2d None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:21.756037 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6752fb-1e23-4faf-b4ef-d67e836d7d2d None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:21.756312 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6752fb-1e23-4faf-b4ef-d67e836d7d2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:21.757480 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6752fb-1e23-4faf-b4ef-d67e836d7d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:21.759487 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6752fb-1e23-4faf-b4ef-d67e836d7d2d None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:21.761346 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 22/43] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 19:59:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:21.761876 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6752fb-1e23-4faf-b4ef-d67e836d7d2d None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:21.816016 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 22/44] 10.222.0.58 () {60 vars in 1131 bytes} [Fri Apr 29 19:59:21 2022] POST /identity/v3/roles => generated 225 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 19:59:21.816016 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265e0ec-a5de-43fd-ba1e-daaef78b6ecd None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:21.886084 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6752fb-1e23-4faf-b4ef-d67e836d7d2d None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:21.923382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265e0ec-a5de-43fd-ba1e-daaef78b6ecd None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:21.931928 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9793b-2647-4356-aaaa-f773f911897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:21.932725 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9793b-2647-4356-aaaa-f773f911897a None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:21.933015 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9793b-2647-4356-aaaa-f773f911897a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:21.933295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9793b-2647-4356-aaaa-f773f911897a None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:21.934467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9793b-2647-4356-aaaa-f773f911897a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:21.936585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9793b-2647-4356-aaaa-f773f911897a None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:21.960352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e35a1-f706-425c-8803-650f210e527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:21.960944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e35a1-f706-425c-8803-650f210e527d None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:21.961284 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e35a1-f706-425c-8803-650f210e527d None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:21.961568 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e35a1-f706-425c-8803-650f210e527d None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:21.962967 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e35a1-f706-425c-8803-650f210e527d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:21.964488 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e35a1-f706-425c-8803-650f210e527d None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:22.034525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 23/45] 10.222.0.58 () {60 vars in 1131 bytes} [Fri Apr 29 19:59:21 2022] POST /identity/v3/roles => generated 223 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 19:59:22.073615 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 23/46] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Apr 29 19:59:21 2022] POST /identity/v3/projects => generated 312 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 19:59:23.751920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde4619-29ff-49b4-98f3-fb26b4eaf2e3 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:23.752433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde4619-29ff-49b4-98f3-fb26b4eaf2e3 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:23.752433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde4619-29ff-49b4-98f3-fb26b4eaf2e3 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:23.753796 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 24/47] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:23.759740 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f62f1a-90c4-4a31-9f71-309c72dab56b None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:23.760234 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f62f1a-90c4-4a31-9f71-309c72dab56b None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:23.760525 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f62f1a-90c4-4a31-9f71-309c72dab56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:23.777410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-28f62f1a-90c4-4a31-9f71-309c72dab56b None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:23.778607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-28f62f1a-90c4-4a31-9f71-309c72dab56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:23.842591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 24/48] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:23.867261 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde4619-29ff-49b4-98f3-fb26b4eaf2e3 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:23.963755 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde4619-29ff-49b4-98f3-fb26b4eaf2e3 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:23.996372 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0e90d-aa17-45db-853d-938a95610043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:23.997164 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0e90d-aa17-45db-853d-938a95610043 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:23.997445 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0e90d-aa17-45db-853d-938a95610043 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:23.997716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0e90d-aa17-45db-853d-938a95610043 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:24.007900 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0e90d-aa17-45db-853d-938a95610043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-aaa0e90d-aa17-45db-853d-938a95610043 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:24.016047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:24.016894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:24.017646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:24.017646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:24.017646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:24.017646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:24.017646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:24.017646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:24.017646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:24.017646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:24.017646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:24.017646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:24.017646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:24.017646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 19:59:24.017646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 25/49] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 19:59:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:24.023054 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f62f1a-90c4-4a31-9f71-309c72dab56b None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:24.116525 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f62f1a-90c4-4a31-9f71-309c72dab56b None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:24.149256 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497d94c-c872-4cb9-8e6c-1b8079c71d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:24.150840 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497d94c-c872-4cb9-8e6c-1b8079c71d5f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:24.151129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497d94c-c872-4cb9-8e6c-1b8079c71d5f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:24.151406 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497d94c-c872-4cb9-8e6c-1b8079c71d5f None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:24.152207 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497d94c-c872-4cb9-8e6c-1b8079c71d5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:24.152519 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497d94c-c872-4cb9-8e6c-1b8079c71d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:24.153955 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497d94c-c872-4cb9-8e6c-1b8079c71d5f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:24.165407 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 25/50] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:24.170881 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0e90d-aa17-45db-853d-938a95610043 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:24.270836 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0e90d-aa17-45db-853d-938a95610043 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:24.302781 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a8a41-2687-4e0f-8556-6a73eab94b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:24.303814 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a8a41-2687-4e0f-8556-6a73eab94b64 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:24.303944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a8a41-2687-4e0f-8556-6a73eab94b64 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:24.304224 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a8a41-2687-4e0f-8556-6a73eab94b64 None admin] PATH_INFO: `/v3/users/60cf68d8163c4e1192fe62342bc80660` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:24.305426 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a8a41-2687-4e0f-8556-6a73eab94b64 None admin] RBAC: Authorizing `identity:get_user(user_id=60cf68d8163c4e1192fe62342bc80660)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:24.307447 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a8a41-2687-4e0f-8556-6a73eab94b64 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:24.309100 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 26/51] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:24 2022] GET /identity/v3/users/60cf68d8163c4e1192fe62342bc80660 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:24.314496 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497d94c-c872-4cb9-8e6c-1b8079c71d5f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:24.384291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c241b-43e5-442e-aa98-c186f1669cb8 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:24.384576 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c241b-43e5-442e-aa98-c186f1669cb8 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:24.384854 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c241b-43e5-442e-aa98-c186f1669cb8 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:24.386210 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 27/52] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 19:59:24.391160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f98a7-52ac-4efb-b048-2b535a823f5d None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:24.391447 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f98a7-52ac-4efb-b048-2b535a823f5d None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:24.391726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f98a7-52ac-4efb-b048-2b535a823f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:24.408705 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-e37f98a7-52ac-4efb-b048-2b535a823f5d None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:24.409879 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-e37f98a7-52ac-4efb-b048-2b535a823f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:24.412397 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497d94c-c872-4cb9-8e6c-1b8079c71d5f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:24.445214 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06798ff7-d5e6-4be4-ac52-e8e34c720a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:24.446009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06798ff7-d5e6-4be4-ac52-e8e34c720a60 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:24.446894 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06798ff7-d5e6-4be4-ac52-e8e34c720a60 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:24.447176 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06798ff7-d5e6-4be4-ac52-e8e34c720a60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:24.448385 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06798ff7-d5e6-4be4-ac52-e8e34c720a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:24.449865 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06798ff7-d5e6-4be4-ac52-e8e34c720a60 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:24.451533 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 19:59:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:24.457217 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06798ff7-d5e6-4be4-ac52-e8e34c720a60 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:24.477461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 28/54] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:24.501583 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f98a7-52ac-4efb-b048-2b535a823f5d None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:24.551237 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06798ff7-d5e6-4be4-ac52-e8e34c720a60 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:24.583758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb3486-1cf2-4423-bc69-b567dcf4e706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:24.584443 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb3486-1cf2-4423-bc69-b567dcf4e706 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:24.584729 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb3486-1cf2-4423-bc69-b567dcf4e706 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:24.585008 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb3486-1cf2-4423-bc69-b567dcf4e706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:24.585831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb3486-1cf2-4423-bc69-b567dcf4e706 None admin] RBAC: Adding query filter params (role.id=5255ed3fa613448fb4c549f5bc7f20af, scope.domain.id=default, user.id=60cf68d8163c4e1192fe62342bc80660) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:24.586140 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb3486-1cf2-4423-bc69-b567dcf4e706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:24.587606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb3486-1cf2-4423-bc69-b567dcf4e706 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:24.593340 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f98a7-52ac-4efb-b048-2b535a823f5d None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:24.596035 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1322 bytes} [Fri Apr 29 19:59:24 2022] GET /identity/v3/role_assignments?user.id=60cf68d8163c4e1192fe62342bc80660&scope.domain.id=default&role.id=5255ed3fa613448fb4c549f5bc7f20af => generated 530 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:24.628032 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954e4e0-a70e-4908-ba61-58be0afe8ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:24.628850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954e4e0-a70e-4908-ba61-58be0afe8ea1 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:24.629142 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954e4e0-a70e-4908-ba61-58be0afe8ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:24.629417 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954e4e0-a70e-4908-ba61-58be0afe8ea1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:24.630658 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954e4e0-a70e-4908-ba61-58be0afe8ea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:24.632183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954e4e0-a70e-4908-ba61-58be0afe8ea1 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:24.634608 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 29/56] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 19:59:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:24.640718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb3486-1cf2-4423-bc69-b567dcf4e706 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:24.745316 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb3486-1cf2-4423-bc69-b567dcf4e706 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:24.779341 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c22e3d-78af-4632-b257-e81e602ead29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:24.780039 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c22e3d-78af-4632-b257-e81e602ead29 None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:24.780331 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c22e3d-78af-4632-b257-e81e602ead29 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:24.780606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c22e3d-78af-4632-b257-e81e602ead29 None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:24.781311 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c22e3d-78af-4632-b257-e81e602ead29 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:24.782759 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c22e3d-78af-4632-b257-e81e602ead29 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:24.890914 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 28/57] 10.222.0.58 () {60 vars in 1140 bytes} [Fri Apr 29 19:59:24 2022] POST /identity/v3/projects => generated 298 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 19:59:27.220760 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d99b7f-a74a-4ef5-bda8-7de38b98e239 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:27.221466 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d99b7f-a74a-4ef5-bda8-7de38b98e239 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:27.221466 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d99b7f-a74a-4ef5-bda8-7de38b98e239 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:27.222789 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 30/58] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:27.228129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b368b-645e-4d95-899d-07e8681cabb0 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:27.228561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b368b-645e-4d95-899d-07e8681cabb0 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:27.228682 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b368b-645e-4d95-899d-07e8681cabb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:27.245136 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-c44b368b-645e-4d95-899d-07e8681cabb0 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:27.246305 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-c44b368b-645e-4d95-899d-07e8681cabb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:27.307962 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 29/59] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:27.333237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d99b7f-a74a-4ef5-bda8-7de38b98e239 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:27.429361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d99b7f-a74a-4ef5-bda8-7de38b98e239 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:27.460121 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2896-22d3-4c48-9bf0-2027d603397c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:27.460909 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2896-22d3-4c48-9bf0-2027d603397c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:27.461194 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2896-22d3-4c48-9bf0-2027d603397c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:27.461472 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2896-22d3-4c48-9bf0-2027d603397c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:27.463137 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e2896-22d3-4c48-9bf0-2027d603397c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:27.464638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e2896-22d3-4c48-9bf0-2027d603397c None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:27.466508 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 31/60] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 19:59:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:27.472110 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b368b-645e-4d95-899d-07e8681cabb0 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:27.594570 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b368b-645e-4d95-899d-07e8681cabb0 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:27.632511 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434618c8-6c32-454b-914c-03f3b56129d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:27.633171 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434618c8-6c32-454b-914c-03f3b56129d1 None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:27.633450 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434618c8-6c32-454b-914c-03f3b56129d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:27.633755 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434618c8-6c32-454b-914c-03f3b56129d1 None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:27.634458 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434618c8-6c32-454b-914c-03f3b56129d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:27.635900 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434618c8-6c32-454b-914c-03f3b56129d1 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:27.724360 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 30/61] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Apr 29 19:59:27 2022] POST /identity/v3/users => generated 275 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 19:59:31.417081 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146f317-3fbf-4b95-9d0e-6f5317f35ef0 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:31.417600 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146f317-3fbf-4b95-9d0e-6f5317f35ef0 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:31.417680 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146f317-3fbf-4b95-9d0e-6f5317f35ef0 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:31.418978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 32/62] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:31.438123 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3c0ef-3c46-4e7f-911a-df32e04e62e8 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:31.438632 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3c0ef-3c46-4e7f-911a-df32e04e62e8 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:31.438704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3c0ef-3c46-4e7f-911a-df32e04e62e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:31.443352 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592de84-5349-41f8-a2e4-d87eb8ac4bcf None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:31.443932 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592de84-5349-41f8-a2e4-d87eb8ac4bcf None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:31.444442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592de84-5349-41f8-a2e4-d87eb8ac4bcf None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:31.446606 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 33/63] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 19:59:31.452659 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d002b-1ade-4175-b337-550b0c451ad8 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:31.453226 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d002b-1ade-4175-b337-550b0c451ad8 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:31.453727 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d002b-1ade-4175-b337-550b0c451ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:31.479181 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-a7c3c0ef-3c46-4e7f-911a-df32e04e62e8 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:31.481068 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-a7c3c0ef-3c46-4e7f-911a-df32e04e62e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:31.487347 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-0e5d002b-1ade-4175-b337-550b0c451ad8 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:31.495390 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-0e5d002b-1ade-4175-b337-550b0c451ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:31.589480 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 31/64] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:31.591145 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe033a-9c4a-47c1-88b0-fe10eff26c60 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:31.591633 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe033a-9c4a-47c1-88b0-fe10eff26c60 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:31.592114 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe033a-9c4a-47c1-88b0-fe10eff26c60 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:31.593541 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 32/65] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:31.604669 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 34/66] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:31.612368 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec192a4-0e8c-4dfb-a380-480a080ca6d9 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:31.612883 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec192a4-0e8c-4dfb-a380-480a080ca6d9 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:31.613330 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec192a4-0e8c-4dfb-a380-480a080ca6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:31.625049 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2666e6-5233-4d0c-9654-2ab97828f179 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:31.625541 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2666e6-5233-4d0c-9654-2ab97828f179 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:31.626005 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2666e6-5233-4d0c-9654-2ab97828f179 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:31.627840 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 35/67] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:31.631490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-3ec192a4-0e8c-4dfb-a380-480a080ca6d9 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:31.632878 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-3ec192a4-0e8c-4dfb-a380-480a080ca6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:31.632990 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198a946-5cd2-4e0f-a0ea-0fb4902059c0 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:31.633244 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198a946-5cd2-4e0f-a0ea-0fb4902059c0 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:31.633592 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198a946-5cd2-4e0f-a0ea-0fb4902059c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:31.654959 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-c198a946-5cd2-4e0f-a0ea-0fb4902059c0 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:31.656245 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-c198a946-5cd2-4e0f-a0ea-0fb4902059c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:31.702878 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 33/68] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:31.704891 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec192a4-0e8c-4dfb-a380-480a080ca6d9 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:31.734690 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 36/69] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:31.735928 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198a946-5cd2-4e0f-a0ea-0fb4902059c0 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:31.819021 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec192a4-0e8c-4dfb-a380-480a080ca6d9 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:31.835363 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198a946-5cd2-4e0f-a0ea-0fb4902059c0 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:31.853932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3ba12-aeb5-4267-a568-75859d1f9414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:31.854782 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3ba12-aeb5-4267-a568-75859d1f9414 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:31.855261 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3ba12-aeb5-4267-a568-75859d1f9414 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:31.855546 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3ba12-aeb5-4267-a568-75859d1f9414 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:31.865221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3ba12-aeb5-4267-a568-75859d1f9414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:31.867732 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f476b6e-1b12-407b-a968-3109e761f1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:31.869058 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f476b6e-1b12-407b-a968-3109e761f1bb None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:31.869337 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f476b6e-1b12-407b-a968-3109e761f1bb None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:31.869608 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f476b6e-1b12-407b-a968-3109e761f1bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-6bd3ba12-aeb5-4267-a568-75859d1f9414 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:31.873452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:31.874277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:31.875043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:31.875043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:31.875043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:31.875043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:31.875043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:31.875043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:31.875043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:31.875043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:31.875043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:31.875043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:31.875043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:31.875043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:31.875043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 34/70] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 19:59:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:31.875673 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3ba12-aeb5-4267-a568-75859d1f9414 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:31.881062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f476b6e-1b12-407b-a968-3109e761f1bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-0f476b6e-1b12-407b-a968-3109e761f1bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:31.889442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:31.890270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:31.891024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:31.891024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:31.891024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:31.891024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:31.891024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:31.891024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:31.891024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:31.891024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:31.891024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:31.891024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:31.891024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:31.891024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 19:59:31.891024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 37/71] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:31.891647 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f476b6e-1b12-407b-a968-3109e761f1bb None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:31.973929 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3ba12-aeb5-4267-a568-75859d1f9414 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:31.983707 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f476b6e-1b12-407b-a968-3109e761f1bb None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:32.005468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f58eb3-b0e1-47e5-8ab5-4b6c18f62682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:32.006266 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f58eb3-b0e1-47e5-8ab5-4b6c18f62682 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:32.006544 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f58eb3-b0e1-47e5-8ab5-4b6c18f62682 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:32.006817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f58eb3-b0e1-47e5-8ab5-4b6c18f62682 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:32.015778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe89ef-b290-463a-bb83-cd43900c3408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:32.016596 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe89ef-b290-463a-bb83-cd43900c3408 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:32.016881 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe89ef-b290-463a-bb83-cd43900c3408 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:32.017009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f58eb3-b0e1-47e5-8ab5-4b6c18f62682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:32.017160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe89ef-b290-463a-bb83-cd43900c3408 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-54f58eb3-b0e1-47e5-8ab5-4b6c18f62682 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:32.025009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:32.025869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:32.026628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:32.026628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:32.026628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:32.026628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:32.026628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:32.026628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:32.026628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:32.026628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:32.026628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:32.026628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:32.026628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 19:59:32.026628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:32.026628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 35/72] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 19:59:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:32.027467 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6894b4b-373d-4efb-a0b5-afe9dc874d24 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:32.027630 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6894b4b-373d-4efb-a0b5-afe9dc874d24 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:32.027909 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6894b4b-373d-4efb-a0b5-afe9dc874d24 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:32.028655 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe89ef-b290-463a-bb83-cd43900c3408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:32.032082 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 36/73] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:32.032082 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6894b4b-373d-4efb-a0b5-afe9dc874d24 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-fbfe89ef-b290-463a-bb83-cd43900c3408 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:32.036377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:32.037258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:32.038010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:32.038010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:32.038010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:32.038010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:32.038010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:32.038010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:32.038010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:32.038010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:32.038010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:32.038010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:32.038010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:32.038010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 19:59:32.038010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 38/74] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:32.038623 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe89ef-b290-463a-bb83-cd43900c3408 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:32.128599 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6894b4b-373d-4efb-a0b5-afe9dc874d24 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:32.132229 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe89ef-b290-463a-bb83-cd43900c3408 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:32.160599 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0857a-bf2b-4e2d-80cd-35462fc73ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:32.161255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0857a-bf2b-4e2d-80cd-35462fc73ec3 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:32.161540 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0857a-bf2b-4e2d-80cd-35462fc73ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:32.161816 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0857a-bf2b-4e2d-80cd-35462fc73ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:32.162557 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0857a-bf2b-4e2d-80cd-35462fc73ec3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:32.162863 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0857a-bf2b-4e2d-80cd-35462fc73ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:32.163728 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc503b-6655-4384-9e05-485a3219b318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:32.164278 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0857a-bf2b-4e2d-80cd-35462fc73ec3 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:32.164417 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc503b-6655-4384-9e05-485a3219b318 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:32.164758 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc503b-6655-4384-9e05-485a3219b318 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:32.165524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc503b-6655-4384-9e05-485a3219b318 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:32.166260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc503b-6655-4384-9e05-485a3219b318 None admin] RBAC: Adding query filter params (name=member) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:32.166564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc503b-6655-4384-9e05-485a3219b318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:32.167920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc503b-6655-4384-9e05-485a3219b318 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:32.172600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 37/75] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:32.172600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0857a-bf2b-4e2d-80cd-35462fc73ec3 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:32.179265 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 39/76] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 19:59:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:32.180564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966228a-cc5e-4792-a3ae-80fa32a1d844 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:32.180853 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966228a-cc5e-4792-a3ae-80fa32a1d844 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:32.181130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966228a-cc5e-4792-a3ae-80fa32a1d844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:32.196957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-8966228a-cc5e-4792-a3ae-80fa32a1d844 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:32.198128 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-8966228a-cc5e-4792-a3ae-80fa32a1d844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:32.260887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 40/77] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:32.272134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966228a-cc5e-4792-a3ae-80fa32a1d844 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:32.272233 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0857a-bf2b-4e2d-80cd-35462fc73ec3 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:32.300127 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b265da-f87e-4754-a683-e258c521c5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:32.300792 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b265da-f87e-4754-a683-e258c521c5fe None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:32.301074 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b265da-f87e-4754-a683-e258c521c5fe None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:32.301349 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b265da-f87e-4754-a683-e258c521c5fe None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:32.302094 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b265da-f87e-4754-a683-e258c521c5fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:32.302403 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b265da-f87e-4754-a683-e258c521c5fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:32.303832 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b265da-f87e-4754-a683-e258c521c5fe None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:32.311748 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 38/78] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 19:59:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:32.312582 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b265da-f87e-4754-a683-e258c521c5fe None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:32.376372 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966228a-cc5e-4792-a3ae-80fa32a1d844 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:32.411568 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099c71-f4b8-4e07-92d7-7e52f03ebb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:32.412200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099c71-f4b8-4e07-92d7-7e52f03ebb92 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:32.412484 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099c71-f4b8-4e07-92d7-7e52f03ebb92 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:32.412761 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099c71-f4b8-4e07-92d7-7e52f03ebb92 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:32.413502 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56099c71-f4b8-4e07-92d7-7e52f03ebb92 None admin] RBAC: Adding query filter params (name=member) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:32.413804 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56099c71-f4b8-4e07-92d7-7e52f03ebb92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:32.415181 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56099c71-f4b8-4e07-92d7-7e52f03ebb92 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:32.420132 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b265da-f87e-4754-a683-e258c521c5fe None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:32.422849 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 41/79] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 19:59:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:32.423640 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099c71-f4b8-4e07-92d7-7e52f03ebb92 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:32.452434 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf66a-73ec-45dc-a08c-81741005c8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:32.453313 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf66a-73ec-45dc-a08c-81741005c8d9 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:32.453592 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf66a-73ec-45dc-a08c-81741005c8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:32.453865 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf66a-73ec-45dc-a08c-81741005c8d9 None admin] PATH_INFO: `/v3/users/60cf68d8163c4e1192fe62342bc80660` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:32.455077 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bf66a-73ec-45dc-a08c-81741005c8d9 None admin] RBAC: Authorizing `identity:get_user(user_id=60cf68d8163c4e1192fe62342bc80660)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:32.456565 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bf66a-73ec-45dc-a08c-81741005c8d9 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:32.458199 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 39/80] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:32 2022] GET /identity/v3/users/60cf68d8163c4e1192fe62342bc80660 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:32.458962 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf66a-73ec-45dc-a08c-81741005c8d9 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:32.517540 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099c71-f4b8-4e07-92d7-7e52f03ebb92 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:32.549834 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8016466-2da7-4c36-973a-0941ceb3621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:32.550709 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8016466-2da7-4c36-973a-0941ceb3621c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:32.550991 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8016466-2da7-4c36-973a-0941ceb3621c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:32.551261 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8016466-2da7-4c36-973a-0941ceb3621c None admin] PATH_INFO: `/v3/users/2e9ab844a05c4fdd9290df822186517e` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:32.552638 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf66a-73ec-45dc-a08c-81741005c8d9 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:32.564466 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8016466-2da7-4c36-973a-0941ceb3621c None admin] RBAC: Authorizing `identity:get_user(user_id=2e9ab844a05c4fdd9290df822186517e)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:32.565931 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8016466-2da7-4c36-973a-0941ceb3621c None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:32.567580 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 42/81] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:32 2022] GET /identity/v3/users/2e9ab844a05c4fdd9290df822186517e => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:32.572363 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8016466-2da7-4c36-973a-0941ceb3621c None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:32.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b5942-22f0-4eeb-9d74-bf81382275d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:32.585294 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b5942-22f0-4eeb-9d74-bf81382275d5 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:32.585578 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b5942-22f0-4eeb-9d74-bf81382275d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:32.585854 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b5942-22f0-4eeb-9d74-bf81382275d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:32.587064 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b5942-22f0-4eeb-9d74-bf81382275d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:32.588594 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b5942-22f0-4eeb-9d74-bf81382275d5 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:32.590232 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 40/82] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 19:59:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:32.590995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b5942-22f0-4eeb-9d74-bf81382275d5 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:32.661186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8016466-2da7-4c36-973a-0941ceb3621c None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:32.696154 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b5942-22f0-4eeb-9d74-bf81382275d5 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:32.696337 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33797d0c-734b-42a0-92e3-abdce60c781f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:32.697118 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33797d0c-734b-42a0-92e3-abdce60c781f None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:32.697408 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33797d0c-734b-42a0-92e3-abdce60c781f None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:32.697674 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33797d0c-734b-42a0-92e3-abdce60c781f None admin] PATH_INFO: `/v3/users/2e9ab844a05c4fdd9290df822186517e` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:32.698878 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33797d0c-734b-42a0-92e3-abdce60c781f None admin] RBAC: Authorizing `identity:get_user(user_id=2e9ab844a05c4fdd9290df822186517e)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:32.700373 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33797d0c-734b-42a0-92e3-abdce60c781f None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:32.702211 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 43/83] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:32 2022] GET /identity/v3/users/2e9ab844a05c4fdd9290df822186517e => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:32.702773 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33797d0c-734b-42a0-92e3-abdce60c781f None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:32.729579 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1b1a6-26f4-4475-bfa3-4573c7b9c958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:32.730715 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1b1a6-26f4-4475-bfa3-4573c7b9c958 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:32.731001 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1b1a6-26f4-4475-bfa3-4573c7b9c958 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:32.731286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1b1a6-26f4-4475-bfa3-4573c7b9c958 None admin] PATH_INFO: `/v3/users/2e9ab844a05c4fdd9290df822186517e` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:32.732518 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1b1a6-26f4-4475-bfa3-4573c7b9c958 None admin] RBAC: Authorizing `identity:get_user(user_id=2e9ab844a05c4fdd9290df822186517e)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:32.733964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1b1a6-26f4-4475-bfa3-4573c7b9c958 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:32.735721 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 41/84] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:32 2022] GET /identity/v3/users/2e9ab844a05c4fdd9290df822186517e => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:32.736721 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1b1a6-26f4-4475-bfa3-4573c7b9c958 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:32.796477 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33797d0c-734b-42a0-92e3-abdce60c781f None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:32.827603 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67547cd8-88f0-4726-abb9-2b45d800ee25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:32.827785 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1b1a6-26f4-4475-bfa3-4573c7b9c958 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:32.828276 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67547cd8-88f0-4726-abb9-2b45d800ee25 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:32.828556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67547cd8-88f0-4726-abb9-2b45d800ee25 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:32.828830 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67547cd8-88f0-4726-abb9-2b45d800ee25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:32.862827 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867dbc1-03e5-4b22-8f31-55f8760f582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:32.863465 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867dbc1-03e5-4b22-8f31-55f8760f582a None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:32.863748 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867dbc1-03e5-4b22-8f31-55f8760f582a None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:32.864050 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867dbc1-03e5-4b22-8f31-55f8760f582a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:32.894168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67547cd8-88f0-4726-abb9-2b45d800ee25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:32.895626 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67547cd8-88f0-4726-abb9-2b45d800ee25 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:32.927413 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867dbc1-03e5-4b22-8f31-55f8760f582a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:32.928902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867dbc1-03e5-4b22-8f31-55f8760f582a None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:32.986470 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 44/85] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 19:59:32.987205 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67547cd8-88f0-4726-abb9-2b45d800ee25 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:33.022813 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 42/86] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 19:59:33.023660 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867dbc1-03e5-4b22-8f31-55f8760f582a None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:33.079863 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67547cd8-88f0-4726-abb9-2b45d800ee25 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:33.112325 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b133d-c3de-487f-b348-6fdb823235e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:33.112994 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b133d-c3de-487f-b348-6fdb823235e2 None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:33.113288 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b133d-c3de-487f-b348-6fdb823235e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:33.113567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b133d-c3de-487f-b348-6fdb823235e2 None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:33.114273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b133d-c3de-487f-b348-6fdb823235e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:33.115711 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b133d-c3de-487f-b348-6fdb823235e2 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:33.116483 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867dbc1-03e5-4b22-8f31-55f8760f582a None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:33.149081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6718a2d-2cde-418c-b574-7c9e1ab4c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:33.150750 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6718a2d-2cde-418c-b574-7c9e1ab4c8b9 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:33.151041 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6718a2d-2cde-418c-b574-7c9e1ab4c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:33.151321 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6718a2d-2cde-418c-b574-7c9e1ab4c8b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:33.215820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6718a2d-2cde-418c-b574-7c9e1ab4c8b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:33.217328 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6718a2d-2cde-418c-b574-7c9e1ab4c8b9 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:33.259427 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 45/87] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Apr 29 19:59:32 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 19:59:33.260646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b133d-c3de-487f-b348-6fdb823235e2 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:33.316602 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 43/88] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 19:59:33.317552 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6718a2d-2cde-418c-b574-7c9e1ab4c8b9 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:33.373329 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b133d-c3de-487f-b348-6fdb823235e2 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:33.409495 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c641f4-e045-4353-b152-9e58110a2948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:33.410168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c641f4-e045-4353-b152-9e58110a2948 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:33.410454 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c641f4-e045-4353-b152-9e58110a2948 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:33.410734 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c641f4-e045-4353-b152-9e58110a2948 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:33.426314 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6718a2d-2cde-418c-b574-7c9e1ab4c8b9 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:33.465592 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d65ba-725b-4f01-9b5f-13d828ff7cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:33.466470 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d65ba-725b-4f01-9b5f-13d828ff7cca None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:33.466754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d65ba-725b-4f01-9b5f-13d828ff7cca None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:33.467029 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d65ba-725b-4f01-9b5f-13d828ff7cca None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:33.468282 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d65ba-725b-4f01-9b5f-13d828ff7cca None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:33.469744 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d65ba-725b-4f01-9b5f-13d828ff7cca None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:33.472468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 44/89] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:33 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:33.472468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d65ba-725b-4f01-9b5f-13d828ff7cca None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:33.481754 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c641f4-e045-4353-b152-9e58110a2948 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:33.483132 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c641f4-e045-4353-b152-9e58110a2948 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:33.575153 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d65ba-725b-4f01-9b5f-13d828ff7cca None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:33.588319 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 46/90] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 19:59:33.589199 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c641f4-e045-4353-b152-9e58110a2948 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:33.611904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dda489-c4dc-49e5-8973-e34a1546f462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:33.612812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dda489-c4dc-49e5-8973-e34a1546f462 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:33.613097 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dda489-c4dc-49e5-8973-e34a1546f462 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:33.613375 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dda489-c4dc-49e5-8973-e34a1546f462 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:33.614597 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dda489-c4dc-49e5-8973-e34a1546f462 None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:33.617055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dda489-c4dc-49e5-8973-e34a1546f462 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:33.618553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 45/91] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:33 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:33.619272 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dda489-c4dc-49e5-8973-e34a1546f462 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:33.697955 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c641f4-e045-4353-b152-9e58110a2948 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:33.733100 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1afc4-a74c-45a5-b822-8bb58a911d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:33.734085 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1afc4-a74c-45a5-b822-8bb58a911d74 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:33.734441 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1afc4-a74c-45a5-b822-8bb58a911d74 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:33.734660 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dda489-c4dc-49e5-8973-e34a1546f462 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:33.734801 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1afc4-a74c-45a5-b822-8bb58a911d74 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:33.736157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1afc4-a74c-45a5-b822-8bb58a911d74 None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:33.738216 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1afc4-a74c-45a5-b822-8bb58a911d74 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:33.739533 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 47/92] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:33 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:33.740488 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1afc4-a74c-45a5-b822-8bb58a911d74 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:33.776957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7210c1-4e17-439a-b47a-593498f24e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:33.777754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7210c1-4e17-439a-b47a-593498f24e93 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:33.778158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7210c1-4e17-439a-b47a-593498f24e93 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:33.778429 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7210c1-4e17-439a-b47a-593498f24e93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:33.779337 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7210c1-4e17-439a-b47a-593498f24e93 None admin] RBAC: Adding query filter params (role.id=5255ed3fa613448fb4c549f5bc7f20af, scope.project.id=52da462806f246f2bf40478b710ccc94, user.id=60cf68d8163c4e1192fe62342bc80660) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:33.779721 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7210c1-4e17-439a-b47a-593498f24e93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:33.781635 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7210c1-4e17-439a-b47a-593498f24e93 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:33.788850 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 46/93] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:33 2022] GET /identity/v3/role_assignments?user.id=60cf68d8163c4e1192fe62342bc80660&scope.project.id=52da462806f246f2bf40478b710ccc94&role.id=5255ed3fa613448fb4c549f5bc7f20af => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:33.794552 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7210c1-4e17-439a-b47a-593498f24e93 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:33.859668 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1afc4-a74c-45a5-b822-8bb58a911d74 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:33.898632 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0290c-87a0-4e12-8ed4-d7136938b8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:33.900000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0290c-87a0-4e12-8ed4-d7136938b8f4 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:33.900764 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0290c-87a0-4e12-8ed4-d7136938b8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:33.901210 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0290c-87a0-4e12-8ed4-d7136938b8f4 None admin] PATH_INFO: `/v3/projects/cce4c98237a54f0a849e4ea71bdbd504` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:33.902661 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0290c-87a0-4e12-8ed4-d7136938b8f4 None admin] RBAC: Authorizing `identity:get_project(project_id=cce4c98237a54f0a849e4ea71bdbd504)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:33.904400 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0290c-87a0-4e12-8ed4-d7136938b8f4 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:33.906373 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 48/94] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:33 2022] GET /identity/v3/projects/cce4c98237a54f0a849e4ea71bdbd504 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:33.907960 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0290c-87a0-4e12-8ed4-d7136938b8f4 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:34.006134 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7210c1-4e17-439a-b47a-593498f24e93 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:34.025843 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0290c-87a0-4e12-8ed4-d7136938b8f4 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:34.055465 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd54f6-9819-4cfe-9439-83968b45b4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:34.056482 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd54f6-9819-4cfe-9439-83968b45b4d8 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:34.056948 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd54f6-9819-4cfe-9439-83968b45b4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:34.057402 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd54f6-9819-4cfe-9439-83968b45b4d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:34.058532 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd54f6-9819-4cfe-9439-83968b45b4d8 None admin] RBAC: Adding query filter params (role.id=a2a640f930c44b2fa40f432179d7faa4, scope.project.id=52da462806f246f2bf40478b710ccc94, user.id=2e9ab844a05c4fdd9290df822186517e) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:34.059068 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd54f6-9819-4cfe-9439-83968b45b4d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:34.060780 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd54f6-9819-4cfe-9439-83968b45b4d8 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:34.067608 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 47/95] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:33 2022] GET /identity/v3/role_assignments?user.id=2e9ab844a05c4fdd9290df822186517e&scope.project.id=52da462806f246f2bf40478b710ccc94&role.id=a2a640f930c44b2fa40f432179d7faa4 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:34.068762 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd54f6-9819-4cfe-9439-83968b45b4d8 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:34.188039 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed44476-8b4e-45de-9a4b-083987e9feb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:34.188645 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed44476-8b4e-45de-9a4b-083987e9feb5 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:34.188934 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed44476-8b4e-45de-9a4b-083987e9feb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:34.189216 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed44476-8b4e-45de-9a4b-083987e9feb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:34.190071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed44476-8b4e-45de-9a4b-083987e9feb5 None admin] RBAC: Adding query filter params (role.id=9487c6d4fd524d9bae767533a1315b15, scope.project.id=52da462806f246f2bf40478b710ccc94, user.id=2e9ab844a05c4fdd9290df822186517e) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:34.190390 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed44476-8b4e-45de-9a4b-083987e9feb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:34.191864 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed44476-8b4e-45de-9a4b-083987e9feb5 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:34.206291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 49/96] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:33 2022] GET /identity/v3/role_assignments?user.id=2e9ab844a05c4fdd9290df822186517e&scope.project.id=52da462806f246f2bf40478b710ccc94&role.id=9487c6d4fd524d9bae767533a1315b15 => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:34.222584 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd54f6-9819-4cfe-9439-83968b45b4d8 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:34.265610 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f270c8-878a-4ac9-8edd-c00f949ad523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:34.266435 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f270c8-878a-4ac9-8edd-c00f949ad523 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:34.266719 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f270c8-878a-4ac9-8edd-c00f949ad523 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:34.266996 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f270c8-878a-4ac9-8edd-c00f949ad523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:34.267859 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f270c8-878a-4ac9-8edd-c00f949ad523 None admin] RBAC: Adding query filter params (role.id=a2a640f930c44b2fa40f432179d7faa4, scope.project.id=cce4c98237a54f0a849e4ea71bdbd504, user.id=2e9ab844a05c4fdd9290df822186517e) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:34.268211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f270c8-878a-4ac9-8edd-c00f949ad523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:34.269876 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f270c8-878a-4ac9-8edd-c00f949ad523 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:34.280334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 48/97] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:34 2022] GET /identity/v3/role_assignments?user.id=2e9ab844a05c4fdd9290df822186517e&scope.project.id=cce4c98237a54f0a849e4ea71bdbd504&role.id=a2a640f930c44b2fa40f432179d7faa4 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:36.215432 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d908c-57d6-4a55-ae3d-07cbeb779360 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:36.216033 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d908c-57d6-4a55-ae3d-07cbeb779360 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:36.216033 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d908c-57d6-4a55-ae3d-07cbeb779360 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:36.217645 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 50/98] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:36.222829 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4292e-821b-48fb-95ba-a9df690ea3cb None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:36.223252 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4292e-821b-48fb-95ba-a9df690ea3cb None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:36.223437 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4292e-821b-48fb-95ba-a9df690ea3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:36.247153 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-f9f4292e-821b-48fb-95ba-a9df690ea3cb None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:36.248371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-f9f4292e-821b-48fb-95ba-a9df690ea3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:36.278088 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621e05e-189d-46d9-b1ba-29c8b2644974 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:36.278391 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621e05e-189d-46d9-b1ba-29c8b2644974 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:36.278649 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621e05e-189d-46d9-b1ba-29c8b2644974 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:36.280044 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 51/99] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 19:59:36.285164 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5f12d-e9b4-4e70-bdc3-858bb78fc3f0 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:36.285462 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5f12d-e9b4-4e70-bdc3-858bb78fc3f0 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:36.285745 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5f12d-e9b4-4e70-bdc3-858bb78fc3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:36.302965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-30d5f12d-e9b4-4e70-bdc3-858bb78fc3f0 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:36.304193 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-30d5f12d-e9b4-4e70-bdc3-858bb78fc3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:36.339909 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 49/100] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:36.388878 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 52/101] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:36.408474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4292e-821b-48fb-95ba-a9df690ea3cb None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:36.421525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5f12d-e9b4-4e70-bdc3-858bb78fc3f0 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:36.521358 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5f12d-e9b4-4e70-bdc3-858bb78fc3f0 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:36.549931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4292e-821b-48fb-95ba-a9df690ea3cb None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:36.558156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca18f2-c504-4063-a918-86ae84c6006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:36.559377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca18f2-c504-4063-a918-86ae84c6006f None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:36.559873 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca18f2-c504-4063-a918-86ae84c6006f None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:36.560416 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca18f2-c504-4063-a918-86ae84c6006f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:36.571256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca18f2-c504-4063-a918-86ae84c6006f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-9fca18f2-c504-4063-a918-86ae84c6006f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:36.579361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:36.580279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:36.581064 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:36.581064 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:36.581064 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:36.581064 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:36.581064 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:36.581064 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:36.581064 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:36.581064 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:36.581064 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:36.581064 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:36.581064 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 19:59:36.581064 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 19:59:36.583421 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 53/102] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 19:59:36.589773 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca18f2-c504-4063-a918-86ae84c6006f None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:36.611350 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2b333-24af-45f4-ac56-36f7301c03f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:36.612505 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2b333-24af-45f4-ac56-36f7301c03f6 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:36.613008 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2b333-24af-45f4-ac56-36f7301c03f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:36.613489 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2b333-24af-45f4-ac56-36f7301c03f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:36.615073 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2b333-24af-45f4-ac56-36f7301c03f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:36.618099 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2b333-24af-45f4-ac56-36f7301c03f6 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:36.628432 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 50/103] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 19:59:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:36.629969 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2b333-24af-45f4-ac56-36f7301c03f6 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:36.806592 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca18f2-c504-4063-a918-86ae84c6006f None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:36.821979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2b333-24af-45f4-ac56-36f7301c03f6 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:36.873795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920edf53-d998-454e-a793-0584f85288c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:36.874769 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920edf53-d998-454e-a793-0584f85288c1 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:36.875057 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920edf53-d998-454e-a793-0584f85288c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:36.875334 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920edf53-d998-454e-a793-0584f85288c1 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:36.876283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920edf53-d998-454e-a793-0584f85288c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:36.876590 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920edf53-d998-454e-a793-0584f85288c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:36.877993 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920edf53-d998-454e-a793-0584f85288c1 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:36.893518 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 54/104] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 19:59:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:36.899227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920edf53-d998-454e-a793-0584f85288c1 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:36.900677 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a32520-3115-4447-aa02-7c7e0da54144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:36.901352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a32520-3115-4447-aa02-7c7e0da54144 None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:36.901635 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a32520-3115-4447-aa02-7c7e0da54144 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:36.901912 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a32520-3115-4447-aa02-7c7e0da54144 None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:36.902625 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a32520-3115-4447-aa02-7c7e0da54144 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:36.904100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a32520-3115-4447-aa02-7c7e0da54144 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:37.023088 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920edf53-d998-454e-a793-0584f85288c1 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:37.041569 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 51/105] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Apr 29 19:59:36 2022] POST /identity/v3/projects => generated 302 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 19:59:37.145472 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5bc5f-b8c5-43a0-a900-75f25308333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:37.146864 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5bc5f-b8c5-43a0-a900-75f25308333c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:37.147358 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5bc5f-b8c5-43a0-a900-75f25308333c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:37.147843 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5bc5f-b8c5-43a0-a900-75f25308333c None admin] PATH_INFO: `/v3/users/2337cc9c52c74643a5ae194f97cd488e` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:37.163092 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5bc5f-b8c5-43a0-a900-75f25308333c None admin] RBAC: Authorizing `identity:get_user(user_id=2337cc9c52c74643a5ae194f97cd488e)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:37.172095 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5bc5f-b8c5-43a0-a900-75f25308333c None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:37.172095 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 55/106] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:36 2022] GET /identity/v3/users/2337cc9c52c74643a5ae194f97cd488e => generated 289 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:37.177183 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a32520-3115-4447-aa02-7c7e0da54144 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:37.317046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a32520-3115-4447-aa02-7c7e0da54144 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:37.355788 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9315ea-7da1-49fc-836e-e35060d43617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:37.356146 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9315ea-7da1-49fc-836e-e35060d43617 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:37.359997 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9315ea-7da1-49fc-836e-e35060d43617 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:37.359997 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9315ea-7da1-49fc-836e-e35060d43617 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:37.453093 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9315ea-7da1-49fc-836e-e35060d43617 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:37.454525 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9315ea-7da1-49fc-836e-e35060d43617 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:37.559594 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 52/107] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 19:59:37.565363 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5bc5f-b8c5-43a0-a900-75f25308333c None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:37.667482 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6972328-61f0-4376-8f67-543c3d68a8ee None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:37.668187 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6972328-61f0-4376-8f67-543c3d68a8ee None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:37.668696 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6972328-61f0-4376-8f67-543c3d68a8ee None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:37.670292 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 53/108] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 19:59:37.685424 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5bc5f-b8c5-43a0-a900-75f25308333c None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:37.686364 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e33a4-49e8-42b2-a636-3a9a58e74fcd None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:37.686872 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e33a4-49e8-42b2-a636-3a9a58e74fcd None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:37.687371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e33a4-49e8-42b2-a636-3a9a58e74fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:37.720968 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182ae67-915e-48e7-849d-60e9dcba41c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:37.721905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182ae67-915e-48e7-849d-60e9dcba41c7 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:37.722190 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182ae67-915e-48e7-849d-60e9dcba41c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:37.722468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182ae67-915e-48e7-849d-60e9dcba41c7 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:37.723676 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182ae67-915e-48e7-849d-60e9dcba41c7 None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:37.725191 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182ae67-915e-48e7-849d-60e9dcba41c7 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:37.727705 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 56/109] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:37 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:37.728877 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-188e33a4-49e8-42b2-a636-3a9a58e74fcd None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:37.729002 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a0f1b-db1d-4f3f-bd6e-47a574ed38c2 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:37.729225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a0f1b-db1d-4f3f-bd6e-47a574ed38c2 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:37.729505 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a0f1b-db1d-4f3f-bd6e-47a574ed38c2 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:37.730998 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 57/110] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:37.732144 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-188e33a4-49e8-42b2-a636-3a9a58e74fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:37.736721 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a0f1b-db1d-4f3f-bd6e-47a574ed38c2 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:37.859669 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a0f1b-db1d-4f3f-bd6e-47a574ed38c2 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:37.896611 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372df98-49ac-49f7-901f-8afd86b1d2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:37.897277 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372df98-49ac-49f7-901f-8afd86b1d2c6 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:37.897739 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372df98-49ac-49f7-901f-8afd86b1d2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:37.898155 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372df98-49ac-49f7-901f-8afd86b1d2c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:37.899522 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372df98-49ac-49f7-901f-8afd86b1d2c6 None admin] RBAC: Adding query filter params (role.id=a82cefb7fdd14179a308031eb40d7e48, scope.project.id=52da462806f246f2bf40478b710ccc94, user.id=2337cc9c52c74643a5ae194f97cd488e) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:37.899839 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372df98-49ac-49f7-901f-8afd86b1d2c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:37.901597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372df98-49ac-49f7-901f-8afd86b1d2c6 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:37.908277 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 58/111] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:37 2022] GET /identity/v3/role_assignments?user.id=2337cc9c52c74643a5ae194f97cd488e&scope.project.id=52da462806f246f2bf40478b710ccc94&role.id=a82cefb7fdd14179a308031eb40d7e48 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:37.909992 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6db498-554e-487e-813d-48d492358061 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:37.910284 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6db498-554e-487e-813d-48d492358061 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:37.910564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6db498-554e-487e-813d-48d492358061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:37.935252 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 54/112] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:37.941377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-7d6db498-554e-487e-813d-48d492358061 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:37.942667 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-7d6db498-554e-487e-813d-48d492358061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:37.973146 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e33a4-49e8-42b2-a636-3a9a58e74fcd None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:38.028416 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 59/113] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:38.029571 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbce2c0-c66a-4f7e-a188-968e169f7069 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:38.029862 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbce2c0-c66a-4f7e-a188-968e169f7069 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:38.030140 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbce2c0-c66a-4f7e-a188-968e169f7069 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:38.031593 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 60/114] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:38.036809 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066cee6-4217-47d2-84a9-fe9b964f332b None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:38.037101 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066cee6-4217-47d2-84a9-fe9b964f332b None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:38.037388 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066cee6-4217-47d2-84a9-fe9b964f332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:38.054984 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-4066cee6-4217-47d2-84a9-fe9b964f332b None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:38.056763 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-4066cee6-4217-47d2-84a9-fe9b964f332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:38.126475 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e33a4-49e8-42b2-a636-3a9a58e74fcd None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:38.130888 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 61/115] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:38.132284 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe581adc-42bd-48ef-9317-173d977ba3f3 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:38.132575 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe581adc-42bd-48ef-9317-173d977ba3f3 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:38.132854 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe581adc-42bd-48ef-9317-173d977ba3f3 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:38.134206 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 62/116] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:38.134913 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe581adc-42bd-48ef-9317-173d977ba3f3 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:38.172370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d789835-7e91-4c38-8865-415c0a22e9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:38.173198 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d789835-7e91-4c38-8865-415c0a22e9f6 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:38.173483 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d789835-7e91-4c38-8865-415c0a22e9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:38.173762 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d789835-7e91-4c38-8865-415c0a22e9f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:38.185675 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d789835-7e91-4c38-8865-415c0a22e9f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-3d789835-7e91-4c38-8865-415c0a22e9f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:38.195708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:38.197945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:38.199907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:38.199907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:38.199907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:38.199907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:38.199907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:38.199907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:38.199907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:38.199907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:38.199907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:38.199907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:38.199907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:38.199907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:38.199907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 55/117] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 19:59:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:38.199907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8217dc-1773-45ef-8721-7fe943c8f07d None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:38.201716 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8217dc-1773-45ef-8721-7fe943c8f07d None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:38.201716 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8217dc-1773-45ef-8721-7fe943c8f07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:38.217252 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-1c8217dc-1773-45ef-8721-7fe943c8f07d None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:38.218441 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-1c8217dc-1773-45ef-8721-7fe943c8f07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:38.260233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe581adc-42bd-48ef-9317-173d977ba3f3 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:38.299902 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91cc18-c3c2-432c-8799-4276f9e0f880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:38.299902 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91cc18-c3c2-432c-8799-4276f9e0f880 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:38.299902 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91cc18-c3c2-432c-8799-4276f9e0f880 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:38.299902 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91cc18-c3c2-432c-8799-4276f9e0f880 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:38.300361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 56/118] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:38.301990 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8217dc-1773-45ef-8721-7fe943c8f07d None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:38.318858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91cc18-c3c2-432c-8799-4276f9e0f880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-af91cc18-c3c2-432c-8799-4276f9e0f880 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:38.328740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:38.338130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:38.338905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:38.338905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:38.338905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:38.338905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:38.338905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:38.338905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:38.338905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:38.338905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:38.338905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:38.338905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:38.338905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 19:59:38.338905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 19:59:38.338905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 63/119] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 19:59:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:38.338905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91cc18-c3c2-432c-8799-4276f9e0f880 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:38.441228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8217dc-1773-45ef-8721-7fe943c8f07d None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:38.449824 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91cc18-c3c2-432c-8799-4276f9e0f880 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:38.489156 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87235817-83ef-4c47-a4b5-cc2b64a7ade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:38.490055 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a567d62-15be-4c27-8640-625fd078a91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:38.491055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87235817-83ef-4c47-a4b5-cc2b64a7ade4 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:38.491886 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a567d62-15be-4c27-8640-625fd078a91c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:38.492504 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a567d62-15be-4c27-8640-625fd078a91c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:38.492635 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87235817-83ef-4c47-a4b5-cc2b64a7ade4 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:38.492991 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87235817-83ef-4c47-a4b5-cc2b64a7ade4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:38.493280 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a567d62-15be-4c27-8640-625fd078a91c None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:38.494217 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a567d62-15be-4c27-8640-625fd078a91c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:38.494716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a567d62-15be-4c27-8640-625fd078a91c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:38.496560 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a567d62-15be-4c27-8640-625fd078a91c None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:38.506274 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87235817-83ef-4c47-a4b5-cc2b64a7ade4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:38.508032 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 64/120] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:38.509739 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a567d62-15be-4c27-8640-625fd078a91c None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-87235817-83ef-4c47-a4b5-cc2b64a7ade4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:38.516545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:38.517405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:38.518172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:38.518172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:38.518172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:38.518172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:38.518172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:38.518172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:38.518172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:38.518172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:38.518172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:38.518172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:38.518172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:38.518172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:38.518172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 57/121] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:38.518821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87235817-83ef-4c47-a4b5-cc2b64a7ade4 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:38.624452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a567d62-15be-4c27-8640-625fd078a91c None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:38.634678 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87235817-83ef-4c47-a4b5-cc2b64a7ade4 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:38.667260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccb57d-7935-42b9-80c3-6f89c6578b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:38.668206 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccb57d-7935-42b9-80c3-6f89c6578b8b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:38.668487 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccb57d-7935-42b9-80c3-6f89c6578b8b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:38.668758 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccb57d-7935-42b9-80c3-6f89c6578b8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:38.669054 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f73636-ccc8-4fb1-8f1c-82ad9456ea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:38.669936 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f73636-ccc8-4fb1-8f1c-82ad9456ea8e None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:38.670417 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f73636-ccc8-4fb1-8f1c-82ad9456ea8e None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:38.670890 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f73636-ccc8-4fb1-8f1c-82ad9456ea8e None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:38.671842 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f73636-ccc8-4fb1-8f1c-82ad9456ea8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:38.672407 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f73636-ccc8-4fb1-8f1c-82ad9456ea8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:38.674007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f73636-ccc8-4fb1-8f1c-82ad9456ea8e None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:38.679721 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccb57d-7935-42b9-80c3-6f89c6578b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:38.682681 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 58/122] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 19:59:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:38.683901 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f73636-ccc8-4fb1-8f1c-82ad9456ea8e None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-81ccb57d-7935-42b9-80c3-6f89c6578b8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:38.689430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:38.690332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:38.691093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:38.691093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:38.691093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:38.691093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:38.691093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:38.691093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:38.691093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:38.691093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:38.691093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:38.691093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:38.691093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:38.691093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 19:59:38.696409 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 65/123] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:38.696409 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccb57d-7935-42b9-80c3-6f89c6578b8b None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:38.795486 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f73636-ccc8-4fb1-8f1c-82ad9456ea8e None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:38.815418 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccb57d-7935-42b9-80c3-6f89c6578b8b None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:38.829533 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932afae6-2fec-4018-a40b-2af9e2d5938d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:38.830718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932afae6-2fec-4018-a40b-2af9e2d5938d None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:38.831203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932afae6-2fec-4018-a40b-2af9e2d5938d None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:38.831706 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932afae6-2fec-4018-a40b-2af9e2d5938d None admin] PATH_INFO: `/v3/users/60cf68d8163c4e1192fe62342bc80660` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:38.833230 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932afae6-2fec-4018-a40b-2af9e2d5938d None admin] RBAC: Authorizing `identity:get_user(user_id=60cf68d8163c4e1192fe62342bc80660)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:38.835014 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932afae6-2fec-4018-a40b-2af9e2d5938d None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:38.837470 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 59/124] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:38 2022] GET /identity/v3/users/60cf68d8163c4e1192fe62342bc80660 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:38.838579 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932afae6-2fec-4018-a40b-2af9e2d5938d None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:38.856208 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ceae71-a9d6-45d4-a680-4c5f7ecc00d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:38.856879 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ceae71-a9d6-45d4-a680-4c5f7ecc00d9 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:38.857160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ceae71-a9d6-45d4-a680-4c5f7ecc00d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:38.857435 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ceae71-a9d6-45d4-a680-4c5f7ecc00d9 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:38.858348 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ceae71-a9d6-45d4-a680-4c5f7ecc00d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:38.858651 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ceae71-a9d6-45d4-a680-4c5f7ecc00d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:38.860341 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ceae71-a9d6-45d4-a680-4c5f7ecc00d9 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:38.870901 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 66/125] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 19:59:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:38.872135 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ceae71-a9d6-45d4-a680-4c5f7ecc00d9 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:38.941275 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932afae6-2fec-4018-a40b-2af9e2d5938d None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:38.969320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ceae71-a9d6-45d4-a680-4c5f7ecc00d9 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:38.975858 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c545530-70f4-4e17-b5c9-6c23a88201fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:38.977663 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c545530-70f4-4e17-b5c9-6c23a88201fe None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:38.978164 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c545530-70f4-4e17-b5c9-6c23a88201fe None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:38.978643 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c545530-70f4-4e17-b5c9-6c23a88201fe None admin] PATH_INFO: `/v3/users/2e9ab844a05c4fdd9290df822186517e` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:38.980488 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c545530-70f4-4e17-b5c9-6c23a88201fe None admin] RBAC: Authorizing `identity:get_user(user_id=2e9ab844a05c4fdd9290df822186517e)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:38.982242 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c545530-70f4-4e17-b5c9-6c23a88201fe None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:38.984121 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 60/126] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:38 2022] GET /identity/v3/users/2e9ab844a05c4fdd9290df822186517e => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:38.985237 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c545530-70f4-4e17-b5c9-6c23a88201fe None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:39.004317 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a460ed7-fca9-49ae-b1bd-d2f8fc3921c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:39.005035 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a460ed7-fca9-49ae-b1bd-d2f8fc3921c9 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:39.005256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a460ed7-fca9-49ae-b1bd-d2f8fc3921c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:39.005525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a460ed7-fca9-49ae-b1bd-d2f8fc3921c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:39.006255 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a460ed7-fca9-49ae-b1bd-d2f8fc3921c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:39.006558 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a460ed7-fca9-49ae-b1bd-d2f8fc3921c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:39.007944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a460ed7-fca9-49ae-b1bd-d2f8fc3921c9 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:39.021206 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 67/127] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 19:59:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:39.021206 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a460ed7-fca9-49ae-b1bd-d2f8fc3921c9 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:39.094158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c545530-70f4-4e17-b5c9-6c23a88201fe None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:39.115793 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a460ed7-fca9-49ae-b1bd-d2f8fc3921c9 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:39.130768 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2d0d8-e46a-4086-a93e-640a4c22844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:39.132191 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2d0d8-e46a-4086-a93e-640a4c22844c None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:39.132691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2d0d8-e46a-4086-a93e-640a4c22844c None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:39.133228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2d0d8-e46a-4086-a93e-640a4c22844c None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:39.134656 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2d0d8-e46a-4086-a93e-640a4c22844c None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:39.136343 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2d0d8-e46a-4086-a93e-640a4c22844c None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:39.138276 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 61/128] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:38 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:39.139323 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2d0d8-e46a-4086-a93e-640a4c22844c None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:39.150840 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bff106-5954-4354-97b5-0c515977fc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:39.151719 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bff106-5954-4354-97b5-0c515977fc52 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:39.152002 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bff106-5954-4354-97b5-0c515977fc52 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:39.152301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bff106-5954-4354-97b5-0c515977fc52 None admin] PATH_INFO: `/v3/users/2e9ab844a05c4fdd9290df822186517e` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:39.153497 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bff106-5954-4354-97b5-0c515977fc52 None admin] RBAC: Authorizing `identity:get_user(user_id=2e9ab844a05c4fdd9290df822186517e)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:39.154961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bff106-5954-4354-97b5-0c515977fc52 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:39.157290 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 68/129] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:39 2022] GET /identity/v3/users/2e9ab844a05c4fdd9290df822186517e => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:39.157792 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bff106-5954-4354-97b5-0c515977fc52 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:39.247249 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2d0d8-e46a-4086-a93e-640a4c22844c None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:39.269872 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bff106-5954-4354-97b5-0c515977fc52 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:39.283581 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900a8d1-b34a-4e6f-a4fb-c2582885910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:39.284801 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900a8d1-b34a-4e6f-a4fb-c2582885910b None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:39.285311 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900a8d1-b34a-4e6f-a4fb-c2582885910b None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:39.285800 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900a8d1-b34a-4e6f-a4fb-c2582885910b None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:39.287244 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4900a8d1-b34a-4e6f-a4fb-c2582885910b None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:39.289007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4900a8d1-b34a-4e6f-a4fb-c2582885910b None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:39.291524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 62/130] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:39 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:39.292658 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900a8d1-b34a-4e6f-a4fb-c2582885910b None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:39.306348 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350f27-f961-43ee-826e-59ff967ca64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:39.307231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350f27-f961-43ee-826e-59ff967ca64d None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:39.307514 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350f27-f961-43ee-826e-59ff967ca64d None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:39.307795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350f27-f961-43ee-826e-59ff967ca64d None admin] PATH_INFO: `/v3/users/2e9ab844a05c4fdd9290df822186517e` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:39.309023 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8350f27-f961-43ee-826e-59ff967ca64d None admin] RBAC: Authorizing `identity:get_user(user_id=2e9ab844a05c4fdd9290df822186517e)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:39.310480 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8350f27-f961-43ee-826e-59ff967ca64d None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:39.312151 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 69/131] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:39 2022] GET /identity/v3/users/2e9ab844a05c4fdd9290df822186517e => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:39.316036 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350f27-f961-43ee-826e-59ff967ca64d None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:39.425904 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350f27-f961-43ee-826e-59ff967ca64d None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:39.426547 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900a8d1-b34a-4e6f-a4fb-c2582885910b None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:39.460085 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f0e1d-361a-44f6-bb0a-04915d99994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:39.461181 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f0e1d-361a-44f6-bb0a-04915d99994a None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:39.461553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3cda6-6d7b-47a3-a5fe-9f81ef2856c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:39.462200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f0e1d-361a-44f6-bb0a-04915d99994a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:39.462615 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f0e1d-361a-44f6-bb0a-04915d99994a None admin] PATH_INFO: `/v3/projects/cce4c98237a54f0a849e4ea71bdbd504` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:39.462741 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3cda6-6d7b-47a3-a5fe-9f81ef2856c9 None admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:39.463097 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3cda6-6d7b-47a3-a5fe-9f81ef2856c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:39.463472 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3cda6-6d7b-47a3-a5fe-9f81ef2856c9 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94/users/60cf68d8163c4e1192fe62342bc80660/roles/5255ed3fa613448fb4c549f5bc7f20af` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:39.464422 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f0e1d-361a-44f6-bb0a-04915d99994a None admin] RBAC: Authorizing `identity:get_project(project_id=cce4c98237a54f0a849e4ea71bdbd504)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:39.465834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3cda6-6d7b-47a3-a5fe-9f81ef2856c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=52da462806f246f2bf40478b710ccc94, user_id=60cf68d8163c4e1192fe62342bc80660, role_id=5255ed3fa613448fb4c549f5bc7f20af)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:39.466284 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f0e1d-361a-44f6-bb0a-04915d99994a None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:39.467526 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3cda6-6d7b-47a3-a5fe-9f81ef2856c9 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:39.468302 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 70/132] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:39 2022] GET /identity/v3/projects/cce4c98237a54f0a849e4ea71bdbd504 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:39.469176 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f0e1d-361a-44f6-bb0a-04915d99994a None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:39.556021 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 63/133] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 19:59:39 2022] PUT /identity/v3/projects/52da462806f246f2bf40478b710ccc94/users/60cf68d8163c4e1192fe62342bc80660/roles/5255ed3fa613448fb4c549f5bc7f20af => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 19:59:39.556021 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3cda6-6d7b-47a3-a5fe-9f81ef2856c9 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:39.596882 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f0e1d-361a-44f6-bb0a-04915d99994a None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:39.667576 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833b340-ab62-4b15-a6b3-fe437fe78555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:39.668574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833b340-ab62-4b15-a6b3-fe437fe78555 None admin] REQUEST_METHOD: `PUT` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:39.668858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833b340-ab62-4b15-a6b3-fe437fe78555 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:39.669133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833b340-ab62-4b15-a6b3-fe437fe78555 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94/users/2e9ab844a05c4fdd9290df822186517e/roles/9487c6d4fd524d9bae767533a1315b15` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:39.673777 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833b340-ab62-4b15-a6b3-fe437fe78555 None admin] RBAC: Authorizing `identity:create_grant(project_id=52da462806f246f2bf40478b710ccc94, user_id=2e9ab844a05c4fdd9290df822186517e, role_id=9487c6d4fd524d9bae767533a1315b15)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:39.675272 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833b340-ab62-4b15-a6b3-fe437fe78555 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:39.728365 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3cda6-6d7b-47a3-a5fe-9f81ef2856c9 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:39.770449 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5e13b-1725-408a-bb3b-25fee0e88b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:39.771385 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5e13b-1725-408a-bb3b-25fee0e88b35 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:39.771668 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5e13b-1725-408a-bb3b-25fee0e88b35 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:39.771959 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5e13b-1725-408a-bb3b-25fee0e88b35 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:39.773312 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5e13b-1725-408a-bb3b-25fee0e88b35 None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:39.774837 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5e13b-1725-408a-bb3b-25fee0e88b35 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:39.776778 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 64/134] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:39 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:39.777565 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5e13b-1725-408a-bb3b-25fee0e88b35 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:39.793707 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 71/135] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 19:59:39 2022] PUT /identity/v3/projects/52da462806f246f2bf40478b710ccc94/users/2e9ab844a05c4fdd9290df822186517e/roles/9487c6d4fd524d9bae767533a1315b15 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 19:59:39.794523 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833b340-ab62-4b15-a6b3-fe437fe78555 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:39.923285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5e13b-1725-408a-bb3b-25fee0e88b35 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:39.975223 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74daf84-6176-421e-b90b-0ed39746ff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:39.976166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74daf84-6176-421e-b90b-0ed39746ff76 None admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:39.976790 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74daf84-6176-421e-b90b-0ed39746ff76 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:39.976790 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74daf84-6176-421e-b90b-0ed39746ff76 None admin] PATH_INFO: `/v3/projects/cce4c98237a54f0a849e4ea71bdbd504/users/2e9ab844a05c4fdd9290df822186517e/roles/a2a640f930c44b2fa40f432179d7faa4` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:39.978952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74daf84-6176-421e-b90b-0ed39746ff76 None admin] RBAC: Authorizing `identity:create_grant(project_id=cce4c98237a54f0a849e4ea71bdbd504, user_id=2e9ab844a05c4fdd9290df822186517e, role_id=a2a640f930c44b2fa40f432179d7faa4)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:39.980847 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74daf84-6176-421e-b90b-0ed39746ff76 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:39.997365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833b340-ab62-4b15-a6b3-fe437fe78555 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:40.037188 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdd2e0-ea78-4a91-9ecb-ea5af68a9c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:40.038096 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdd2e0-ea78-4a91-9ecb-ea5af68a9c52 None admin] REQUEST_METHOD: `PUT` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:40.038379 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdd2e0-ea78-4a91-9ecb-ea5af68a9c52 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:40.038656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdd2e0-ea78-4a91-9ecb-ea5af68a9c52 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94/users/2e9ab844a05c4fdd9290df822186517e/roles/a2a640f930c44b2fa40f432179d7faa4` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:40.040773 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdd2e0-ea78-4a91-9ecb-ea5af68a9c52 None admin] RBAC: Authorizing `identity:create_grant(project_id=52da462806f246f2bf40478b710ccc94, user_id=2e9ab844a05c4fdd9290df822186517e, role_id=a2a640f930c44b2fa40f432179d7faa4)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:40.042249 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdd2e0-ea78-4a91-9ecb-ea5af68a9c52 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:40.099048 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 65/136] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 19:59:39 2022] PUT /identity/v3/projects/cce4c98237a54f0a849e4ea71bdbd504/users/2e9ab844a05c4fdd9290df822186517e/roles/a2a640f930c44b2fa40f432179d7faa4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 19:59:40.100410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836c79c-a65a-42c0-a6c1-93ca8b1e582a None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:40.100697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836c79c-a65a-42c0-a6c1-93ca8b1e582a None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:40.100975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836c79c-a65a-42c0-a6c1-93ca8b1e582a None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:40.102317 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 66/137] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:40.108490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5f178-50dc-406e-89bf-f771dd3f4800 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:40.108979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5f178-50dc-406e-89bf-f771dd3f4800 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:40.109274 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5f178-50dc-406e-89bf-f771dd3f4800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:40.128512 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-50f5f178-50dc-406e-89bf-f771dd3f4800 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:40.129853 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-50f5f178-50dc-406e-89bf-f771dd3f4800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:40.150675 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 72/138] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 19:59:39 2022] PUT /identity/v3/projects/52da462806f246f2bf40478b710ccc94/users/2e9ab844a05c4fdd9290df822186517e/roles/a2a640f930c44b2fa40f432179d7faa4 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 19:59:40.213748 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 67/139] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:40.258853 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdd2e0-ea78-4a91-9ecb-ea5af68a9c52 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:40.379556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdd2e0-ea78-4a91-9ecb-ea5af68a9c52 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:40.418064 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9dc69-feb4-42dd-aa6b-67cf9ccd0376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:40.418894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9dc69-feb4-42dd-aa6b-67cf9ccd0376 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:40.419173 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9dc69-feb4-42dd-aa6b-67cf9ccd0376 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:40.419446 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9dc69-feb4-42dd-aa6b-67cf9ccd0376 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:40.420778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9dc69-feb4-42dd-aa6b-67cf9ccd0376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:40.422302 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9dc69-feb4-42dd-aa6b-67cf9ccd0376 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:40.424461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 73/140] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 19:59:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:40.429831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5f178-50dc-406e-89bf-f771dd3f4800 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:40.573557 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5f178-50dc-406e-89bf-f771dd3f4800 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:40.608135 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0f41c-fb69-4057-95e1-0ca150049cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:40.608812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0f41c-fb69-4057-95e1-0ca150049cad None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:40.609095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0f41c-fb69-4057-95e1-0ca150049cad None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:40.609370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0f41c-fb69-4057-95e1-0ca150049cad None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:40.610098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0f41c-fb69-4057-95e1-0ca150049cad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:40.611559 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0f41c-fb69-4057-95e1-0ca150049cad None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:40.666171 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcad5a-99ea-4036-ad0c-c61d76348a8e None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:40.666480 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcad5a-99ea-4036-ad0c-c61d76348a8e None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:40.666725 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcad5a-99ea-4036-ad0c-c61d76348a8e None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:40.668434 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 74/141] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:40.674509 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278628-d213-49b6-a253-6238c15792c7 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:40.674802 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278628-d213-49b6-a253-6238c15792c7 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:40.675080 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278628-d213-49b6-a253-6238c15792c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:40.693770 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-62278628-d213-49b6-a253-6238c15792c7 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:40.694952 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-62278628-d213-49b6-a253-6238c15792c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:40.747760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 68/142] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Apr 29 19:59:40 2022] POST /identity/v3/users => generated 283 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 19:59:40.797350 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 75/143] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:40.852595 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0f41c-fb69-4057-95e1-0ca150049cad None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:40.978377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0f41c-fb69-4057-95e1-0ca150049cad None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:41.022571 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d1d2f-fe73-4e80-99b3-1987f9eca602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:41.023375 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d1d2f-fe73-4e80-99b3-1987f9eca602 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:41.023661 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d1d2f-fe73-4e80-99b3-1987f9eca602 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:41.024493 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d1d2f-fe73-4e80-99b3-1987f9eca602 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:41.040824 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d1d2f-fe73-4e80-99b3-1987f9eca602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-e51d1d2f-fe73-4e80-99b3-1987f9eca602 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:41.048804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:41.049685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:41.050439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:41.050439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:41.050439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:41.050439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:41.050439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:41.050439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:41.050439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:41.050439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:41.050439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:41.050439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:41.050439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 19:59:41.050439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:41.053587 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 69/144] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:41.061998 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62278628-d213-49b6-a253-6238c15792c7 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:41.217830 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62278628-d213-49b6-a253-6238c15792c7 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:41.257086 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4437f59-b29a-4714-92f9-2b44672a8868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:41.257990 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4437f59-b29a-4714-92f9-2b44672a8868 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:41.258975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4437f59-b29a-4714-92f9-2b44672a8868 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:41.259436 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4437f59-b29a-4714-92f9-2b44672a8868 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:41.260377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4437f59-b29a-4714-92f9-2b44672a8868 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:41.260813 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4437f59-b29a-4714-92f9-2b44672a8868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:41.262334 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4437f59-b29a-4714-92f9-2b44672a8868 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:41.270984 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 76/145] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 19:59:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:41.277058 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d1d2f-fe73-4e80-99b3-1987f9eca602 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:41.454366 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d1d2f-fe73-4e80-99b3-1987f9eca602 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:41.504969 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad8278-be9e-44d3-ba56-727232a90ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:41.505833 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad8278-be9e-44d3-ba56-727232a90ebb None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:41.506121 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad8278-be9e-44d3-ba56-727232a90ebb None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:41.506395 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad8278-be9e-44d3-ba56-727232a90ebb None admin] PATH_INFO: `/v3/users/2337cc9c52c74643a5ae194f97cd488e` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:41.507619 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad8278-be9e-44d3-ba56-727232a90ebb None admin] RBAC: Authorizing `identity:get_user(user_id=2337cc9c52c74643a5ae194f97cd488e)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:41.509142 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad8278-be9e-44d3-ba56-727232a90ebb None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:41.511056 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 70/146] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:41 2022] GET /identity/v3/users/2337cc9c52c74643a5ae194f97cd488e => generated 289 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:41.516503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4437f59-b29a-4714-92f9-2b44672a8868 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:41.646592 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4437f59-b29a-4714-92f9-2b44672a8868 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:41.682535 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbe444-4b41-4c72-81b4-7db3755adeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:41.687996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbe444-4b41-4c72-81b4-7db3755adeb5 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:41.687996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbe444-4b41-4c72-81b4-7db3755adeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:41.687996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbe444-4b41-4c72-81b4-7db3755adeb5 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:41.687996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbe444-4b41-4c72-81b4-7db3755adeb5 None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:41.687996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbe444-4b41-4c72-81b4-7db3755adeb5 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:41.688345 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 77/147] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:41 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:41.694606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad8278-be9e-44d3-ba56-727232a90ebb None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:41.798910 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad8278-be9e-44d3-ba56-727232a90ebb None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:41.833085 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc873ebd-1978-48f0-9f04-537587f7bec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:41.833990 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc873ebd-1978-48f0-9f04-537587f7bec1 None admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:41.834269 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc873ebd-1978-48f0-9f04-537587f7bec1 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:41.834545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc873ebd-1978-48f0-9f04-537587f7bec1 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94/users/2337cc9c52c74643a5ae194f97cd488e/roles/a82cefb7fdd14179a308031eb40d7e48` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:41.837090 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc873ebd-1978-48f0-9f04-537587f7bec1 None admin] RBAC: Authorizing `identity:create_grant(project_id=52da462806f246f2bf40478b710ccc94, user_id=2337cc9c52c74643a5ae194f97cd488e, role_id=a82cefb7fdd14179a308031eb40d7e48)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:41.838538 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc873ebd-1978-48f0-9f04-537587f7bec1 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:41.939360 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 71/148] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 19:59:41 2022] PUT /identity/v3/projects/52da462806f246f2bf40478b710ccc94/users/2337cc9c52c74643a5ae194f97cd488e/roles/a82cefb7fdd14179a308031eb40d7e48 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 19:59:42.600901 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52d9c4-2136-418e-b89d-eaeb7fb081dd None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:42.601254 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52d9c4-2136-418e-b89d-eaeb7fb081dd None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:42.601425 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52d9c4-2136-418e-b89d-eaeb7fb081dd None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:42.602946 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 78/149] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:42.608334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f0814-c127-4ee5-873c-59d06d3c238e None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:42.608626 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f0814-c127-4ee5-873c-59d06d3c238e None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:42.608906 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f0814-c127-4ee5-873c-59d06d3c238e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:42.627031 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-8e5f0814-c127-4ee5-873c-59d06d3c238e None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:42.628246 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-8e5f0814-c127-4ee5-873c-59d06d3c238e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:42.696456 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 72/150] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:42.719926 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52d9c4-2136-418e-b89d-eaeb7fb081dd None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:42.826366 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52d9c4-2136-418e-b89d-eaeb7fb081dd None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:42.864240 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89754148-9e5f-428e-b10c-f50b2f6b4874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:42.864959 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89754148-9e5f-428e-b10c-f50b2f6b4874 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:42.865240 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89754148-9e5f-428e-b10c-f50b2f6b4874 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:42.865513 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89754148-9e5f-428e-b10c-f50b2f6b4874 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:42.876310 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89754148-9e5f-428e-b10c-f50b2f6b4874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-89754148-9e5f-428e-b10c-f50b2f6b4874 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:42.886537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:42.888639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:42.890503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:42.890503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:42.890503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:42.890503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:42.890503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:42.890503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:42.890503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:42.890503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:42.890503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:42.890503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:42.890503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:42.890503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 19:59:42.893687 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 79/151] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 19:59:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:42.895320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f0814-c127-4ee5-873c-59d06d3c238e None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:42.998956 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f0814-c127-4ee5-873c-59d06d3c238e None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:43.034433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f487684-543b-44c2-a518-e84e605b2d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:43.035113 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f487684-543b-44c2-a518-e84e605b2d80 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:43.035397 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f487684-543b-44c2-a518-e84e605b2d80 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:43.035674 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f487684-543b-44c2-a518-e84e605b2d80 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:43.036459 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f487684-543b-44c2-a518-e84e605b2d80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:43.036763 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f487684-543b-44c2-a518-e84e605b2d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:43.038199 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f487684-543b-44c2-a518-e84e605b2d80 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:43.047657 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 73/152] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:43.053311 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89754148-9e5f-428e-b10c-f50b2f6b4874 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:43.209710 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89754148-9e5f-428e-b10c-f50b2f6b4874 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:43.252095 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7149d-bafd-47fd-9e9b-7f7988c7fb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:43.253229 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7149d-bafd-47fd-9e9b-7f7988c7fb09 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:43.253654 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7149d-bafd-47fd-9e9b-7f7988c7fb09 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:43.254086 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7149d-bafd-47fd-9e9b-7f7988c7fb09 None admin] PATH_INFO: `/v3/users/60cf68d8163c4e1192fe62342bc80660` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:43.258879 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7149d-bafd-47fd-9e9b-7f7988c7fb09 None admin] RBAC: Authorizing `identity:get_user(user_id=60cf68d8163c4e1192fe62342bc80660)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:43.260572 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7149d-bafd-47fd-9e9b-7f7988c7fb09 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:43.262796 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 80/153] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:43 2022] GET /identity/v3/users/60cf68d8163c4e1192fe62342bc80660 => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:43.269595 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f487684-543b-44c2-a518-e84e605b2d80 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:43.393387 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f487684-543b-44c2-a518-e84e605b2d80 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:43.427373 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93484b7f-5037-4590-b8ef-ff493117bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:43.428062 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93484b7f-5037-4590-b8ef-ff493117bfad None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:43.428351 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93484b7f-5037-4590-b8ef-ff493117bfad None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:43.428628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93484b7f-5037-4590-b8ef-ff493117bfad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:43.496703 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93484b7f-5037-4590-b8ef-ff493117bfad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:43.498089 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93484b7f-5037-4590-b8ef-ff493117bfad None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:43.594908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 74/154] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 19:59:43.600279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7149d-bafd-47fd-9e9b-7f7988c7fb09 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:43.710966 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7149d-bafd-47fd-9e9b-7f7988c7fb09 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:43.745198 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cb6e5-7a32-4fe9-8e60-eb5b5e60942d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:43.746051 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cb6e5-7a32-4fe9-8e60-eb5b5e60942d None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:43.746327 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cb6e5-7a32-4fe9-8e60-eb5b5e60942d None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:43.746595 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cb6e5-7a32-4fe9-8e60-eb5b5e60942d None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:43.747849 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cb6e5-7a32-4fe9-8e60-eb5b5e60942d None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:43.749286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cb6e5-7a32-4fe9-8e60-eb5b5e60942d None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:43.751221 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 81/155] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:43 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:43.756888 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93484b7f-5037-4590-b8ef-ff493117bfad None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:43.858258 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93484b7f-5037-4590-b8ef-ff493117bfad None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:43.892376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072d6e5-5180-4706-9b6f-42ae4996cbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:43.893048 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072d6e5-5180-4706-9b6f-42ae4996cbd6 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:43.893329 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072d6e5-5180-4706-9b6f-42ae4996cbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:43.893603 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072d6e5-5180-4706-9b6f-42ae4996cbd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:43.894440 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072d6e5-5180-4706-9b6f-42ae4996cbd6 None admin] RBAC: Adding query filter params (role.id=5255ed3fa613448fb4c549f5bc7f20af, scope.project.id=52da462806f246f2bf40478b710ccc94, user.id=60cf68d8163c4e1192fe62342bc80660) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:43.894750 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072d6e5-5180-4706-9b6f-42ae4996cbd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:43.896225 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072d6e5-5180-4706-9b6f-42ae4996cbd6 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:43.903201 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 75/156] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:43 2022] GET /identity/v3/role_assignments?user.id=60cf68d8163c4e1192fe62342bc80660&scope.project.id=52da462806f246f2bf40478b710ccc94&role.id=5255ed3fa613448fb4c549f5bc7f20af => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:44.314723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8fdb5-ce26-4b0d-b890-61f762e6aec7 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:44.315081 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8fdb5-ce26-4b0d-b890-61f762e6aec7 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:44.315275 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8fdb5-ce26-4b0d-b890-61f762e6aec7 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:44.316867 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 82/157] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:44.324850 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31a80a-1e4d-44da-9689-bb4f09146be3 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:44.325166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31a80a-1e4d-44da-9689-bb4f09146be3 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:44.325418 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31a80a-1e4d-44da-9689-bb4f09146be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:44.344294 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-da31a80a-1e4d-44da-9689-bb4f09146be3 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:44.348867 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-da31a80a-1e4d-44da-9689-bb4f09146be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:44.434464 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 76/158] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:44.486815 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8fdb5-ce26-4b0d-b890-61f762e6aec7 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:44.607443 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8fdb5-ce26-4b0d-b890-61f762e6aec7 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:44.630469 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25617afb-9332-4ff8-ae96-730cafb3148d None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:44.630773 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25617afb-9332-4ff8-ae96-730cafb3148d None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:44.631026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25617afb-9332-4ff8-ae96-730cafb3148d None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:44.632655 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 77/159] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:44.638557 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762eec2-de4a-4239-8e44-ca6de6691d74 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:44.639216 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762eec2-de4a-4239-8e44-ca6de6691d74 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:44.639216 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762eec2-de4a-4239-8e44-ca6de6691d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:44.674273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-8762eec2-de4a-4239-8e44-ca6de6691d74 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:44.675995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-8762eec2-de4a-4239-8e44-ca6de6691d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:44.684991 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f7ea5-04bd-49ce-a507-49e5bff46d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:44.685980 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f7ea5-04bd-49ce-a507-49e5bff46d69 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:44.686262 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f7ea5-04bd-49ce-a507-49e5bff46d69 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:44.686659 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f7ea5-04bd-49ce-a507-49e5bff46d69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:44.722556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f7ea5-04bd-49ce-a507-49e5bff46d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-4a6f7ea5-04bd-49ce-a507-49e5bff46d69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:44.730860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:44.732967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:44.734974 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:44.734974 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:44.734974 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:44.734974 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:44.734974 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:44.734974 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:44.734974 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:44.734974 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:44.734974 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:44.734974 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:44.734974 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:44.734974 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 19:59:44.740500 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 83/160] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:44.747492 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f7ea5-04bd-49ce-a507-49e5bff46d69 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:44.800620 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 78/161] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:44.857532 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762eec2-de4a-4239-8e44-ca6de6691d74 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:44.875931 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f7ea5-04bd-49ce-a507-49e5bff46d69 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:44.920448 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127d308-4f65-4962-a6ea-87492ccbb22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:44.921120 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127d308-4f65-4962-a6ea-87492ccbb22c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:44.921395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127d308-4f65-4962-a6ea-87492ccbb22c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:44.921665 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127d308-4f65-4962-a6ea-87492ccbb22c None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:44.922590 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127d308-4f65-4962-a6ea-87492ccbb22c None admin] RBAC: Adding query filter params (name=member) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:44.922897 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127d308-4f65-4962-a6ea-87492ccbb22c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:44.927786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127d308-4f65-4962-a6ea-87492ccbb22c None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:44.951285 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 84/162] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 19:59:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:44.956242 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ac722-4157-4741-80c7-b6cf8a6ee20e None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:44.956521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ac722-4157-4741-80c7-b6cf8a6ee20e None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:44.956792 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ac722-4157-4741-80c7-b6cf8a6ee20e None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:44.958171 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 85/163] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:44.958874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ac722-4157-4741-80c7-b6cf8a6ee20e None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:45.087222 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762eec2-de4a-4239-8e44-ca6de6691d74 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:45.154615 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9970e-022b-47cb-8af6-a7c44c2431c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:45.155346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9970e-022b-47cb-8af6-a7c44c2431c5 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:45.155626 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9970e-022b-47cb-8af6-a7c44c2431c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:45.155893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9970e-022b-47cb-8af6-a7c44c2431c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:45.170361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ac722-4157-4741-80c7-b6cf8a6ee20e None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:45.180961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9970e-022b-47cb-8af6-a7c44c2431c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-2af9970e-022b-47cb-8af6-a7c44c2431c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:45.193701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:45.194583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:45.195951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:45.195951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:45.195951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:45.195951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:45.195951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:45.195951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:45.195951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:45.195951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:45.195951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:45.195951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:45.195951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 19:59:45.195951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:45.195951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 79/164] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 19:59:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:45.197376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eb89d-3d89-4d67-ad15-463f8a7ea847 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:45.197376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eb89d-3d89-4d67-ad15-463f8a7ea847 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:45.197376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eb89d-3d89-4d67-ad15-463f8a7ea847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:45.238396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-bc0eb89d-3d89-4d67-ad15-463f8a7ea847 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:45.239561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-bc0eb89d-3d89-4d67-ad15-463f8a7ea847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:45.242012 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae11550-fcd2-4d44-9d71-237eb8688271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:45.243456 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae11550-fcd2-4d44-9d71-237eb8688271 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:45.243729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae11550-fcd2-4d44-9d71-237eb8688271 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:45.245359 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae11550-fcd2-4d44-9d71-237eb8688271 None admin] PATH_INFO: `/v3/users/2e9ab844a05c4fdd9290df822186517e` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:45.245359 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae11550-fcd2-4d44-9d71-237eb8688271 None admin] RBAC: Authorizing `identity:get_user(user_id=2e9ab844a05c4fdd9290df822186517e)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:45.246667 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae11550-fcd2-4d44-9d71-237eb8688271 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:45.248332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 86/165] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:44 2022] GET /identity/v3/users/2e9ab844a05c4fdd9290df822186517e => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:45.249088 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae11550-fcd2-4d44-9d71-237eb8688271 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:45.358049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 80/166] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:45.359933 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0eb89d-3d89-4d67-ad15-463f8a7ea847 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:45.370490 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae11550-fcd2-4d44-9d71-237eb8688271 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:45.424514 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417947f-2e9d-4b03-8b22-37b39754487e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:45.425840 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417947f-2e9d-4b03-8b22-37b39754487e None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:45.426472 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417947f-2e9d-4b03-8b22-37b39754487e None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:45.427085 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417947f-2e9d-4b03-8b22-37b39754487e None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:45.428594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417947f-2e9d-4b03-8b22-37b39754487e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:45.429249 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417947f-2e9d-4b03-8b22-37b39754487e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:45.431332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417947f-2e9d-4b03-8b22-37b39754487e None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:45.447702 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 87/167] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 19:59:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:45.448809 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417947f-2e9d-4b03-8b22-37b39754487e None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:45.485019 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0eb89d-3d89-4d67-ad15-463f8a7ea847 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:45.521258 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51869fcd-27f7-44a3-b971-a80519a5ad25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:45.522310 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51869fcd-27f7-44a3-b971-a80519a5ad25 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:45.522737 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51869fcd-27f7-44a3-b971-a80519a5ad25 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:45.523200 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51869fcd-27f7-44a3-b971-a80519a5ad25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:45.621511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417947f-2e9d-4b03-8b22-37b39754487e None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:45.633936 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51869fcd-27f7-44a3-b971-a80519a5ad25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:45.635430 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51869fcd-27f7-44a3-b971-a80519a5ad25 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:45.728799 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be753729-b3d6-4a2f-a7c1-ee6486b35d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:45.729527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be753729-b3d6-4a2f-a7c1-ee6486b35d38 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:45.730071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be753729-b3d6-4a2f-a7c1-ee6486b35d38 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:45.730340 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be753729-b3d6-4a2f-a7c1-ee6486b35d38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:45.746605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 81/168] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 19:59:45.753286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51869fcd-27f7-44a3-b971-a80519a5ad25 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:45.760894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be753729-b3d6-4a2f-a7c1-ee6486b35d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-be753729-b3d6-4a2f-a7c1-ee6486b35d38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:45.775999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:45.777067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:45.777943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:45.777943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:45.777943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:45.777943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:45.777943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:45.777943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:45.777943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:45.777943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:45.777943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:45.777943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:45.777943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:45.777943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 19:59:45.780150 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 88/169] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:45.781097 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be753729-b3d6-4a2f-a7c1-ee6486b35d38 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:45.860663 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51869fcd-27f7-44a3-b971-a80519a5ad25 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:45.904291 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e765de6-b20e-445a-94ab-02ff340bfd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:45.905649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e765de6-b20e-445a-94ab-02ff340bfd5d None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:45.907369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e765de6-b20e-445a-94ab-02ff340bfd5d None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:45.908507 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e765de6-b20e-445a-94ab-02ff340bfd5d None admin] PATH_INFO: `/v3/users/2e9ab844a05c4fdd9290df822186517e` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:45.910717 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e765de6-b20e-445a-94ab-02ff340bfd5d None admin] RBAC: Authorizing `identity:get_user(user_id=2e9ab844a05c4fdd9290df822186517e)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:45.912534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e765de6-b20e-445a-94ab-02ff340bfd5d None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:45.915568 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 82/170] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:45 2022] GET /identity/v3/users/2e9ab844a05c4fdd9290df822186517e => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:45.917386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e765de6-b20e-445a-94ab-02ff340bfd5d None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:46.005664 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be753729-b3d6-4a2f-a7c1-ee6486b35d38 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:46.077862 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cae66b-3f6c-46c0-a5a9-9b5ea4496b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:46.079285 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cae66b-3f6c-46c0-a5a9-9b5ea4496b80 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:46.079706 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cae66b-3f6c-46c0-a5a9-9b5ea4496b80 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:46.080296 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cae66b-3f6c-46c0-a5a9-9b5ea4496b80 None admin] PATH_INFO: `/v3/projects/cce4c98237a54f0a849e4ea71bdbd504` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:46.085174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cae66b-3f6c-46c0-a5a9-9b5ea4496b80 None admin] RBAC: Authorizing `identity:get_project(project_id=cce4c98237a54f0a849e4ea71bdbd504)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:46.087391 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cae66b-3f6c-46c0-a5a9-9b5ea4496b80 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:46.089645 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 89/171] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:45 2022] GET /identity/v3/projects/cce4c98237a54f0a849e4ea71bdbd504 => generated 312 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:46.090568 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cae66b-3f6c-46c0-a5a9-9b5ea4496b80 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:46.148169 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e765de6-b20e-445a-94ab-02ff340bfd5d None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:46.188421 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843073e-cdcd-44b9-ba34-d868a67aaf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:46.189441 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843073e-cdcd-44b9-ba34-d868a67aaf6a None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:46.189930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843073e-cdcd-44b9-ba34-d868a67aaf6a None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:46.190403 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843073e-cdcd-44b9-ba34-d868a67aaf6a None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:46.191522 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843073e-cdcd-44b9-ba34-d868a67aaf6a None admin] RBAC: Adding query filter params (name=member) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:46.192054 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843073e-cdcd-44b9-ba34-d868a67aaf6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:46.193788 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843073e-cdcd-44b9-ba34-d868a67aaf6a None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:46.203136 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 83/172] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 19:59:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:46.208701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843073e-cdcd-44b9-ba34-d868a67aaf6a None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:46.293388 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cae66b-3f6c-46c0-a5a9-9b5ea4496b80 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:46.332148 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f928a-14e3-4144-b5f0-f8b21373e0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:46.333106 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f928a-14e3-4144-b5f0-f8b21373e0c2 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:46.333567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f928a-14e3-4144-b5f0-f8b21373e0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:46.334015 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f928a-14e3-4144-b5f0-f8b21373e0c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:46.350817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843073e-cdcd-44b9-ba34-d868a67aaf6a None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:46.391365 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d52c5-0fbf-433b-90fd-190c7eb88cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:46.392738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d52c5-0fbf-433b-90fd-190c7eb88cf5 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:46.393307 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d52c5-0fbf-433b-90fd-190c7eb88cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:46.393809 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d52c5-0fbf-433b-90fd-190c7eb88cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:46.394897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d52c5-0fbf-433b-90fd-190c7eb88cf5 None admin] RBAC: Adding query filter params (role.id=a2a640f930c44b2fa40f432179d7faa4, scope.project.id=cce4c98237a54f0a849e4ea71bdbd504, user.id=2e9ab844a05c4fdd9290df822186517e) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:46.395427 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d52c5-0fbf-433b-90fd-190c7eb88cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:46.397276 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d52c5-0fbf-433b-90fd-190c7eb88cf5 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:46.404279 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 84/173] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:46 2022] GET /identity/v3/role_assignments?user.id=2e9ab844a05c4fdd9290df822186517e&scope.project.id=cce4c98237a54f0a849e4ea71bdbd504&role.id=a2a640f930c44b2fa40f432179d7faa4 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:46.406140 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0401c22-cccf-4907-baa3-b78ff8c27167 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:46.406646 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0401c22-cccf-4907-baa3-b78ff8c27167 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:46.407118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0401c22-cccf-4907-baa3-b78ff8c27167 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:46.408818 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 85/174] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:46.409906 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0401c22-cccf-4907-baa3-b78ff8c27167 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:46.438626 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f928a-14e3-4144-b5f0-f8b21373e0c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:46.445510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f928a-14e3-4144-b5f0-f8b21373e0c2 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:46.550077 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 90/175] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 19:59:46.551750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d8991-d1ba-4e59-8384-a5009e8d3732 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:46.552216 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d8991-d1ba-4e59-8384-a5009e8d3732 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:46.552647 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d8991-d1ba-4e59-8384-a5009e8d3732 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:46.554313 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 91/176] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:46.556081 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adfa44-0a3b-4f68-b5d1-167a8c105e6a None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:46.556503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adfa44-0a3b-4f68-b5d1-167a8c105e6a None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:46.556915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adfa44-0a3b-4f68-b5d1-167a8c105e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:46.574672 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-79adfa44-0a3b-4f68-b5d1-167a8c105e6a None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:46.576264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-79adfa44-0a3b-4f68-b5d1-167a8c105e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:46.577253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0401c22-cccf-4907-baa3-b78ff8c27167 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:46.613279 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8add0f-3feb-4fe3-a84d-4860a9f0d07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:46.614648 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8add0f-3feb-4fe3-a84d-4860a9f0d07f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:46.615190 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8add0f-3feb-4fe3-a84d-4860a9f0d07f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:46.615554 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8add0f-3feb-4fe3-a84d-4860a9f0d07f None admin] PATH_INFO: `/v3/users/2e9ab844a05c4fdd9290df822186517e` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:46.617036 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8add0f-3feb-4fe3-a84d-4860a9f0d07f None admin] RBAC: Authorizing `identity:get_user(user_id=2e9ab844a05c4fdd9290df822186517e)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:46.619320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8add0f-3feb-4fe3-a84d-4860a9f0d07f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:46.626023 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 86/177] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:46 2022] GET /identity/v3/users/2e9ab844a05c4fdd9290df822186517e => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:46.627295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8add0f-3feb-4fe3-a84d-4860a9f0d07f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:46.648887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 92/178] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:46.650465 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580f4ce-f42f-4671-8bda-03775ea70baa None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:46.650751 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580f4ce-f42f-4671-8bda-03775ea70baa None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:46.651021 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580f4ce-f42f-4671-8bda-03775ea70baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:46.671470 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-1580f4ce-f42f-4671-8bda-03775ea70baa None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:46.673200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-1580f4ce-f42f-4671-8bda-03775ea70baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:46.745774 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8add0f-3feb-4fe3-a84d-4860a9f0d07f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:46.754139 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 93/179] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:46.755792 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b456a63-4a88-4f95-9590-bac8c2b002ab None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:46.756311 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b456a63-4a88-4f95-9590-bac8c2b002ab None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:46.756734 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b456a63-4a88-4f95-9590-bac8c2b002ab None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:46.758465 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 94/180] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:46.759799 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2211f41-a298-4e8f-95bd-39dfc178fa78 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:46.760259 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2211f41-a298-4e8f-95bd-39dfc178fa78 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:46.760685 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2211f41-a298-4e8f-95bd-39dfc178fa78 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:46.761920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 95/181] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:46.763353 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2211f41-a298-4e8f-95bd-39dfc178fa78 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:46.785564 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1ab64-772b-4066-9d60-6ce691f3f51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:46.786418 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1ab64-772b-4066-9d60-6ce691f3f51d None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:46.786695 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1ab64-772b-4066-9d60-6ce691f3f51d None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:46.786967 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1ab64-772b-4066-9d60-6ce691f3f51d None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:46.788208 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1ab64-772b-4066-9d60-6ce691f3f51d None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:46.790226 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1ab64-772b-4066-9d60-6ce691f3f51d None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:46.791950 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 87/182] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:46 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:46.792740 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1ab64-772b-4066-9d60-6ce691f3f51d None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:46.865117 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2211f41-a298-4e8f-95bd-39dfc178fa78 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:46.886192 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1ab64-772b-4066-9d60-6ce691f3f51d None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:46.897141 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e825a-7dc9-4520-a889-e111a24a4ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:46.897783 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e825a-7dc9-4520-a889-e111a24a4ca6 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:46.898067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e825a-7dc9-4520-a889-e111a24a4ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:46.898339 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e825a-7dc9-4520-a889-e111a24a4ca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:46.918120 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67229c62-2185-4cb0-8300-6c821802e994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:46.918904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67229c62-2185-4cb0-8300-6c821802e994 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:46.919186 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67229c62-2185-4cb0-8300-6c821802e994 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:46.919455 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67229c62-2185-4cb0-8300-6c821802e994 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:46.929186 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67229c62-2185-4cb0-8300-6c821802e994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-67229c62-2185-4cb0-8300-6c821802e994 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:46.936834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:46.937710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:46.938499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:46.938499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:46.938499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:46.938499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:46.938499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:46.938499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:46.938499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:46.938499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:46.938499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:46.938499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:46.938499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:46.938499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:46.938499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 88/183] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 19:59:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:46.939635 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa5e9-a4ff-489d-9ca5-3255964753d6 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:46.939739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa5e9-a4ff-489d-9ca5-3255964753d6 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:46.940046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa5e9-a4ff-489d-9ca5-3255964753d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:46.956688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-b67aa5e9-a4ff-489d-9ca5-3255964753d6 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:46.957877 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-b67aa5e9-a4ff-489d-9ca5-3255964753d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:46.962949 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e825a-7dc9-4520-a889-e111a24a4ca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:46.964449 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e825a-7dc9-4520-a889-e111a24a4ca6 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:47.020850 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 89/184] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:47.022278 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f8892-c681-441c-8732-b36b80940481 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:47.022567 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f8892-c681-441c-8732-b36b80940481 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:47.022846 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f8892-c681-441c-8732-b36b80940481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:47.041794 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-931f8892-c681-441c-8732-b36b80940481 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:47.042988 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-931f8892-c681-441c-8732-b36b80940481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:47.062698 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 96/185] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 19:59:47.063342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e825a-7dc9-4520-a889-e111a24a4ca6 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:47.114306 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 90/186] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:47.115215 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f8892-c681-441c-8732-b36b80940481 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:47.163221 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e825a-7dc9-4520-a889-e111a24a4ca6 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:47.195144 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c30966-f0b3-4529-a3bb-1c4cd6661af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:47.195950 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c30966-f0b3-4529-a3bb-1c4cd6661af9 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:47.196263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c30966-f0b3-4529-a3bb-1c4cd6661af9 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:47.196529 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c30966-f0b3-4529-a3bb-1c4cd6661af9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:47.205993 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c30966-f0b3-4529-a3bb-1c4cd6661af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:47.209996 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f8892-c681-441c-8732-b36b80940481 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-06c30966-f0b3-4529-a3bb-1c4cd6661af9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:47.214170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:47.215153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:47.215933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:47.215933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:47.215933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:47.215933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:47.215933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:47.215933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:47.215933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:47.215933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:47.215933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:47.215933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:47.215933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 19:59:47.215933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 19:59:47.215933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 97/187] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:47.216607 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c30966-f0b3-4529-a3bb-1c4cd6661af9 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:47.243146 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7593b-8354-4fe4-9bd0-951693a4b5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:47.244025 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7593b-8354-4fe4-9bd0-951693a4b5a5 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:47.245330 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7593b-8354-4fe4-9bd0-951693a4b5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:47.247058 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7593b-8354-4fe4-9bd0-951693a4b5a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:47.249053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7593b-8354-4fe4-9bd0-951693a4b5a5 None admin] RBAC: Adding query filter params (role.id=9487c6d4fd524d9bae767533a1315b15, scope.project.id=52da462806f246f2bf40478b710ccc94, user.id=2e9ab844a05c4fdd9290df822186517e) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:47.249391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7593b-8354-4fe4-9bd0-951693a4b5a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:47.250863 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7593b-8354-4fe4-9bd0-951693a4b5a5 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:47.256704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 91/188] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:47 2022] GET /identity/v3/role_assignments?user.id=2e9ab844a05c4fdd9290df822186517e&scope.project.id=52da462806f246f2bf40478b710ccc94&role.id=9487c6d4fd524d9bae767533a1315b15 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:47.257632 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7593b-8354-4fe4-9bd0-951693a4b5a5 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:47.325977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c30966-f0b3-4529-a3bb-1c4cd6661af9 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:47.362405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f382c4c-9ea6-4844-8462-a7e3922182be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:47.363086 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f382c4c-9ea6-4844-8462-a7e3922182be None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:47.363365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f382c4c-9ea6-4844-8462-a7e3922182be None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:47.363640 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f382c4c-9ea6-4844-8462-a7e3922182be None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:47.364440 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f382c4c-9ea6-4844-8462-a7e3922182be None admin] RBAC: Adding query filter params (name=admin) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:47.364747 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f382c4c-9ea6-4844-8462-a7e3922182be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:47.366259 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f382c4c-9ea6-4844-8462-a7e3922182be None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:47.369515 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7593b-8354-4fe4-9bd0-951693a4b5a5 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:47.375945 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 98/189] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:47.377170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f382c4c-9ea6-4844-8462-a7e3922182be None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:47.420375 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6da8e8-f598-4feb-bd99-a69303a15026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:47.421202 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6da8e8-f598-4feb-bd99-a69303a15026 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:47.421481 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6da8e8-f598-4feb-bd99-a69303a15026 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:47.421755 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6da8e8-f598-4feb-bd99-a69303a15026 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:47.436652 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6da8e8-f598-4feb-bd99-a69303a15026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-da6da8e8-f598-4feb-bd99-a69303a15026 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:47.444926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:47.445821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:47.446596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:47.446596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:47.446596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:47.446596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:47.446596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:47.446596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:47.446596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:47.446596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:47.446596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:47.446596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:47.446596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 19:59:47.446596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:47.446596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 92/190] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 19:59:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:47.448514 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6da8e8-f598-4feb-bd99-a69303a15026 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:47.491527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f382c4c-9ea6-4844-8462-a7e3922182be None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:47.524887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734afeec-d6f1-499d-b722-ca5044cdf028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:47.525744 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734afeec-d6f1-499d-b722-ca5044cdf028 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:47.526017 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734afeec-d6f1-499d-b722-ca5044cdf028 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:47.526286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734afeec-d6f1-499d-b722-ca5044cdf028 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:47.527448 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734afeec-d6f1-499d-b722-ca5044cdf028 None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:47.528914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734afeec-d6f1-499d-b722-ca5044cdf028 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:47.530653 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 99/191] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:47 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:47.531400 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734afeec-d6f1-499d-b722-ca5044cdf028 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:47.552601 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6da8e8-f598-4feb-bd99-a69303a15026 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:47.584024 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99cbcd-80aa-4904-b8af-d5c3f2c7368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:47.584813 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99cbcd-80aa-4904-b8af-d5c3f2c7368a None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:47.585090 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99cbcd-80aa-4904-b8af-d5c3f2c7368a None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:47.585360 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99cbcd-80aa-4904-b8af-d5c3f2c7368a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:47.586534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99cbcd-80aa-4904-b8af-d5c3f2c7368a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:47.588029 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99cbcd-80aa-4904-b8af-d5c3f2c7368a None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:47.589632 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 93/192] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 19:59:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:47.590377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99cbcd-80aa-4904-b8af-d5c3f2c7368a None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:47.625575 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734afeec-d6f1-499d-b722-ca5044cdf028 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:47.656497 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472b4e6-fc78-4146-8af8-c6708533b009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:47.657152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472b4e6-fc78-4146-8af8-c6708533b009 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:47.657429 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472b4e6-fc78-4146-8af8-c6708533b009 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:47.657703 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472b4e6-fc78-4146-8af8-c6708533b009 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:47.658438 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472b4e6-fc78-4146-8af8-c6708533b009 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:47.658739 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472b4e6-fc78-4146-8af8-c6708533b009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:47.660156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472b4e6-fc78-4146-8af8-c6708533b009 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:47.668513 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 100/193] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 19:59:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:47.669289 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472b4e6-fc78-4146-8af8-c6708533b009 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:47.684424 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99cbcd-80aa-4904-b8af-d5c3f2c7368a None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:47.715782 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9eae9-e464-4557-b5d2-a05c035267f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:47.716660 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9eae9-e464-4557-b5d2-a05c035267f9 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:47.716951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9eae9-e464-4557-b5d2-a05c035267f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:47.717226 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9eae9-e464-4557-b5d2-a05c035267f9 None admin] PATH_INFO: `/v3/users/40814dda8a7e441db83244192255d631` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:47.732207 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9eae9-e464-4557-b5d2-a05c035267f9 None admin] RBAC: Authorizing `identity:get_user(user_id=40814dda8a7e441db83244192255d631)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:47.733679 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9eae9-e464-4557-b5d2-a05c035267f9 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:47.735342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 94/194] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:47 2022] GET /identity/v3/users/40814dda8a7e441db83244192255d631 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:47.736214 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9eae9-e464-4557-b5d2-a05c035267f9 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:47.761569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472b4e6-fc78-4146-8af8-c6708533b009 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:47.793733 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4239f-8ae7-4fb0-a52d-0f6e6ad1202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:47.794381 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4239f-8ae7-4fb0-a52d-0f6e6ad1202c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:47.794655 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4239f-8ae7-4fb0-a52d-0f6e6ad1202c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:47.794921 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4239f-8ae7-4fb0-a52d-0f6e6ad1202c None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:47.795651 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4239f-8ae7-4fb0-a52d-0f6e6ad1202c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:47.795947 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4239f-8ae7-4fb0-a52d-0f6e6ad1202c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:47.797344 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4239f-8ae7-4fb0-a52d-0f6e6ad1202c None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:47.805203 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 101/195] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 19:59:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:47.805757 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4239f-8ae7-4fb0-a52d-0f6e6ad1202c None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:47.828428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9eae9-e464-4557-b5d2-a05c035267f9 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:47.860987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5fac2-b4b0-44de-bd82-4db92f9fcaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:47.861631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5fac2-b4b0-44de-bd82-4db92f9fcaf1 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:47.861912 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5fac2-b4b0-44de-bd82-4db92f9fcaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:47.862187 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5fac2-b4b0-44de-bd82-4db92f9fcaf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:47.863000 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5fac2-b4b0-44de-bd82-4db92f9fcaf1 None admin] RBAC: Adding query filter params (role.id=a2a640f930c44b2fa40f432179d7faa4, scope.project.id=52da462806f246f2bf40478b710ccc94, user.id=2e9ab844a05c4fdd9290df822186517e) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:47.863309 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5fac2-b4b0-44de-bd82-4db92f9fcaf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:47.864782 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5fac2-b4b0-44de-bd82-4db92f9fcaf1 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:47.870301 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 95/196] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:47 2022] GET /identity/v3/role_assignments?user.id=2e9ab844a05c4fdd9290df822186517e&scope.project.id=52da462806f246f2bf40478b710ccc94&role.id=a2a640f930c44b2fa40f432179d7faa4 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:47.871070 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5fac2-b4b0-44de-bd82-4db92f9fcaf1 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:47.906434 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4239f-8ae7-4fb0-a52d-0f6e6ad1202c None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:47.940703 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edd796-3bff-43de-a6db-dc5800b710bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:47.941386 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edd796-3bff-43de-a6db-dc5800b710bf None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:47.941661 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edd796-3bff-43de-a6db-dc5800b710bf None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:47.941928 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edd796-3bff-43de-a6db-dc5800b710bf None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:47.942652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edd796-3bff-43de-a6db-dc5800b710bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:47.944153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edd796-3bff-43de-a6db-dc5800b710bf None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:47.987110 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5fac2-b4b0-44de-bd82-4db92f9fcaf1 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:48.021390 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214a2b-9e9f-4629-b084-6d5739e76e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:48.022556 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214a2b-9e9f-4629-b084-6d5739e76e72 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:48.022834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214a2b-9e9f-4629-b084-6d5739e76e72 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:48.023105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214a2b-9e9f-4629-b084-6d5739e76e72 None admin] PATH_INFO: `/v3/users/2337cc9c52c74643a5ae194f97cd488e` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:48.024933 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10214a2b-9e9f-4629-b084-6d5739e76e72 None admin] RBAC: Authorizing `identity:get_user(user_id=2337cc9c52c74643a5ae194f97cd488e)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:48.026413 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10214a2b-9e9f-4629-b084-6d5739e76e72 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:48.028152 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 96/197] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:47 2022] GET /identity/v3/users/2337cc9c52c74643a5ae194f97cd488e => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:48.028929 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214a2b-9e9f-4629-b084-6d5739e76e72 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:48.052325 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 102/198] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Apr 29 19:59:47 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 19:59:48.053689 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edd796-3bff-43de-a6db-dc5800b710bf None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:48.178411 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214a2b-9e9f-4629-b084-6d5739e76e72 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:48.208607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42928f2e-8ed9-41fe-8b79-2223ff5a1ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:48.209270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42928f2e-8ed9-41fe-8b79-2223ff5a1ebc None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:48.209553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42928f2e-8ed9-41fe-8b79-2223ff5a1ebc None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:48.209831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42928f2e-8ed9-41fe-8b79-2223ff5a1ebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:48.210487 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edd796-3bff-43de-a6db-dc5800b710bf None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:48.247509 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09373b9d-6eb4-473c-8018-2a54721e8697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:48.248465 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09373b9d-6eb4-473c-8018-2a54721e8697 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:48.248744 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09373b9d-6eb4-473c-8018-2a54721e8697 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:48.249449 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09373b9d-6eb4-473c-8018-2a54721e8697 None admin] PATH_INFO: `/v3/users/40814dda8a7e441db83244192255d631` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:48.250884 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09373b9d-6eb4-473c-8018-2a54721e8697 None admin] RBAC: Authorizing `identity:get_user(user_id=40814dda8a7e441db83244192255d631)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:48.252451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09373b9d-6eb4-473c-8018-2a54721e8697 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:48.254155 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 103/199] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:48 2022] GET /identity/v3/users/40814dda8a7e441db83244192255d631 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:48.254931 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09373b9d-6eb4-473c-8018-2a54721e8697 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:48.281524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42928f2e-8ed9-41fe-8b79-2223ff5a1ebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:48.282991 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42928f2e-8ed9-41fe-8b79-2223ff5a1ebc None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:48.362196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09373b9d-6eb4-473c-8018-2a54721e8697 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:48.388320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 97/200] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 19:59:48.388996 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42928f2e-8ed9-41fe-8b79-2223ff5a1ebc None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:48.399319 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9ee35-3fbb-4420-bfa3-21d9c0b01619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:48.403138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9ee35-3fbb-4420-bfa3-21d9c0b01619 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:48.403138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9ee35-3fbb-4420-bfa3-21d9c0b01619 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:48.403138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9ee35-3fbb-4420-bfa3-21d9c0b01619 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:48.475045 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9ee35-3fbb-4420-bfa3-21d9c0b01619 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:48.476470 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9ee35-3fbb-4420-bfa3-21d9c0b01619 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:48.490384 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42928f2e-8ed9-41fe-8b79-2223ff5a1ebc None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:48.526500 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1df8f-d235-4515-800d-abfecdda77e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:48.527445 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1df8f-d235-4515-800d-abfecdda77e2 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:48.527897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1df8f-d235-4515-800d-abfecdda77e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:48.528392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1df8f-d235-4515-800d-abfecdda77e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:48.577384 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 104/201] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 19:59:48.578330 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9ee35-3fbb-4420-bfa3-21d9c0b01619 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:48.597625 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1df8f-d235-4515-800d-abfecdda77e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:48.599438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1df8f-d235-4515-800d-abfecdda77e2 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:48.676188 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9ee35-3fbb-4420-bfa3-21d9c0b01619 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:48.697842 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 98/202] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 19:59:48.698905 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1df8f-d235-4515-800d-abfecdda77e2 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:48.710611 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd2bae-8589-4b46-8fbb-99bef8d6d749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:48.712107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd2bae-8589-4b46-8fbb-99bef8d6d749 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:48.712316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd2bae-8589-4b46-8fbb-99bef8d6d749 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:48.712609 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd2bae-8589-4b46-8fbb-99bef8d6d749 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:48.713789 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd2bae-8589-4b46-8fbb-99bef8d6d749 None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:48.715339 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd2bae-8589-4b46-8fbb-99bef8d6d749 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:48.721752 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 105/203] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:48 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:48.721752 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd2bae-8589-4b46-8fbb-99bef8d6d749 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:48.805252 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1df8f-d235-4515-800d-abfecdda77e2 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:48.819367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd2bae-8589-4b46-8fbb-99bef8d6d749 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:48.840044 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6017e-ea7c-490d-aa9a-3bfeec527402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:48.841150 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6017e-ea7c-490d-aa9a-3bfeec527402 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:48.841592 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6017e-ea7c-490d-aa9a-3bfeec527402 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:48.842000 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6017e-ea7c-490d-aa9a-3bfeec527402 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:48.843313 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6017e-ea7c-490d-aa9a-3bfeec527402 None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:48.844934 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6017e-ea7c-490d-aa9a-3bfeec527402 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:48.847059 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 99/204] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:48 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:48.848091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6017e-ea7c-490d-aa9a-3bfeec527402 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:48.856475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd891a0-a4c8-4ef2-bc0d-3f294b11e0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:48.857478 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd891a0-a4c8-4ef2-bc0d-3f294b11e0f5 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:48.857893 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd891a0-a4c8-4ef2-bc0d-3f294b11e0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:48.858440 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd891a0-a4c8-4ef2-bc0d-3f294b11e0f5 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:48.859550 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd891a0-a4c8-4ef2-bc0d-3f294b11e0f5 None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:48.861151 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd891a0-a4c8-4ef2-bc0d-3f294b11e0f5 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:48.863275 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 106/205] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:48 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:48.864221 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd891a0-a4c8-4ef2-bc0d-3f294b11e0f5 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:48.948720 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6017e-ea7c-490d-aa9a-3bfeec527402 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:48.963399 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd891a0-a4c8-4ef2-bc0d-3f294b11e0f5 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:48.983629 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420af83-9b3e-4ca9-aee6-48ed9e34a66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:48.984625 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420af83-9b3e-4ca9-aee6-48ed9e34a66a None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:48.985065 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420af83-9b3e-4ca9-aee6-48ed9e34a66a None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:48.985498 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420af83-9b3e-4ca9-aee6-48ed9e34a66a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:48.991991 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420af83-9b3e-4ca9-aee6-48ed9e34a66a None admin] RBAC: Adding query filter params (role.id=5255ed3fa613448fb4c549f5bc7f20af, scope.project.id=68ea978bc82b479ea618aa819bb351fc, user.id=40814dda8a7e441db83244192255d631) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:48.991991 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420af83-9b3e-4ca9-aee6-48ed9e34a66a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:48.991991 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420af83-9b3e-4ca9-aee6-48ed9e34a66a None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:48.995333 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 100/206] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:48 2022] GET /identity/v3/role_assignments?user.id=40814dda8a7e441db83244192255d631&scope.project.id=68ea978bc82b479ea618aa819bb351fc&role.id=5255ed3fa613448fb4c549f5bc7f20af => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:48.996477 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420af83-9b3e-4ca9-aee6-48ed9e34a66a None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:48.997862 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a019bad-27e4-463d-8836-140a64ba8e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:48.998651 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a019bad-27e4-463d-8836-140a64ba8e05 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:48.999007 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a019bad-27e4-463d-8836-140a64ba8e05 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:48.999356 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a019bad-27e4-463d-8836-140a64ba8e05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:49.000325 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a019bad-27e4-463d-8836-140a64ba8e05 None admin] RBAC: Adding query filter params (role.id=a82cefb7fdd14179a308031eb40d7e48, scope.project.id=52da462806f246f2bf40478b710ccc94, user.id=2337cc9c52c74643a5ae194f97cd488e) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:49.000713 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a019bad-27e4-463d-8836-140a64ba8e05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:49.002326 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a019bad-27e4-463d-8836-140a64ba8e05 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:49.009686 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 107/207] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:48 2022] GET /identity/v3/role_assignments?user.id=2337cc9c52c74643a5ae194f97cd488e&scope.project.id=52da462806f246f2bf40478b710ccc94&role.id=a82cefb7fdd14179a308031eb40d7e48 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:49.122704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420af83-9b3e-4ca9-aee6-48ed9e34a66a None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:49.166502 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f887db-9726-4667-84d7-28f9e9ba45dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:49.167435 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f887db-9726-4667-84d7-28f9e9ba45dd None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:49.167864 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f887db-9726-4667-84d7-28f9e9ba45dd None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:49.168300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f887db-9726-4667-84d7-28f9e9ba45dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:49.169289 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f887db-9726-4667-84d7-28f9e9ba45dd None admin] RBAC: Adding query filter params (role.id=9487c6d4fd524d9bae767533a1315b15, scope.project.id=68ea978bc82b479ea618aa819bb351fc, user.id=40814dda8a7e441db83244192255d631) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:49.169772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f887db-9726-4667-84d7-28f9e9ba45dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:49.171438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f887db-9726-4667-84d7-28f9e9ba45dd None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:49.178349 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 101/208] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:48 2022] GET /identity/v3/role_assignments?user.id=40814dda8a7e441db83244192255d631&scope.project.id=68ea978bc82b479ea618aa819bb351fc&role.id=9487c6d4fd524d9bae767533a1315b15 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:50.696596 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da302c7d-d50d-419c-bddb-702f9790a84c None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:50.697089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da302c7d-d50d-419c-bddb-702f9790a84c None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:50.697089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da302c7d-d50d-419c-bddb-702f9790a84c None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:50.698665 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 108/209] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:50.704058 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e29c3-91f6-4016-8e63-38c277a9bf52 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:50.704454 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e29c3-91f6-4016-8e63-38c277a9bf52 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:50.704645 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e29c3-91f6-4016-8e63-38c277a9bf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:50.722413 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-1c6e29c3-91f6-4016-8e63-38c277a9bf52 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:50.723594 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-1c6e29c3-91f6-4016-8e63-38c277a9bf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:50.791070 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 102/210] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:50.792169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc81dfd-1ea8-4f59-a44f-32549af19cc1 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:50.792748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc81dfd-1ea8-4f59-a44f-32549af19cc1 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:50.793213 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc81dfd-1ea8-4f59-a44f-32549af19cc1 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:50.794742 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 109/211] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 19:59:50.800230 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef27e7-ae81-47b9-a688-ee9a5b314236 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:50.800763 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef27e7-ae81-47b9-a688-ee9a5b314236 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:50.801251 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef27e7-ae81-47b9-a688-ee9a5b314236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:50.817123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc81dfd-1ea8-4f59-a44f-32549af19cc1 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:50.819486 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-eeef27e7-ae81-47b9-a688-ee9a5b314236 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:50.821440 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-eeef27e7-ae81-47b9-a688-ee9a5b314236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:50.889239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 103/212] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:50.913728 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef27e7-ae81-47b9-a688-ee9a5b314236 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:50.921916 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc81dfd-1ea8-4f59-a44f-32549af19cc1 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:50.957907 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72167db9-9cad-4853-9518-816dddb5b559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:50.958663 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72167db9-9cad-4853-9518-816dddb5b559 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:50.958951 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72167db9-9cad-4853-9518-816dddb5b559 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:50.959221 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72167db9-9cad-4853-9518-816dddb5b559 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:50.960448 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72167db9-9cad-4853-9518-816dddb5b559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:50.962629 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72167db9-9cad-4853-9518-816dddb5b559 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:50.964588 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 110/213] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 19:59:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:50.970034 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72167db9-9cad-4853-9518-816dddb5b559 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:51.015506 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef27e7-ae81-47b9-a688-ee9a5b314236 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:51.050179 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f82f88-b089-456b-b00f-0afbc157bc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:51.051301 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f82f88-b089-456b-b00f-0afbc157bc6e None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:51.051806 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f82f88-b089-456b-b00f-0afbc157bc6e None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:51.052263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f82f88-b089-456b-b00f-0afbc157bc6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:51.062677 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f82f88-b089-456b-b00f-0afbc157bc6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-34f82f88-b089-456b-b00f-0afbc157bc6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:51.071203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:51.072107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:51.072904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:51.072904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:51.072904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:51.072904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:51.072904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:51.072904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:51.072904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:51.072904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:51.072904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:51.072904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:51.072904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:51.072904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:51.073504 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72167db9-9cad-4853-9518-816dddb5b559 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:51.080159 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 104/214] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:51.086597 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f82f88-b089-456b-b00f-0afbc157bc6e None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:51.108751 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a96df-b6d0-4740-98cf-d249ab585e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:51.109511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a96df-b6d0-4740-98cf-d249ab585e11 None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:51.109917 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a96df-b6d0-4740-98cf-d249ab585e11 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:51.110286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a96df-b6d0-4740-98cf-d249ab585e11 None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:51.111134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a96df-b6d0-4740-98cf-d249ab585e11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:51.112684 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a96df-b6d0-4740-98cf-d249ab585e11 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:51.182591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f82f88-b089-456b-b00f-0afbc157bc6e None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:51.224036 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ab48-22fa-4def-80e1-59453ee5e8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:51.224695 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ab48-22fa-4def-80e1-59453ee5e8b7 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:51.225329 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ab48-22fa-4def-80e1-59453ee5e8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:51.225605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ab48-22fa-4def-80e1-59453ee5e8b7 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:51.226377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ab48-22fa-4def-80e1-59453ee5e8b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:51.226728 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ab48-22fa-4def-80e1-59453ee5e8b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:51.228222 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ab48-22fa-4def-80e1-59453ee5e8b7 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:51.237162 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 105/215] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 19:59:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:51.242461 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ab48-22fa-4def-80e1-59453ee5e8b7 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:51.255630 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 111/216] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Apr 29 19:59:50 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 19:59:51.365928 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ab48-22fa-4def-80e1-59453ee5e8b7 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:51.387442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1eb84-1340-4992-89af-44c02e94e82d None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:51.387740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1eb84-1340-4992-89af-44c02e94e82d None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:51.388028 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1eb84-1340-4992-89af-44c02e94e82d None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:51.393504 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 112/217] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 19:59:51.395270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794e43c-d488-42ad-8abb-82a15c972899 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:51.395625 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794e43c-d488-42ad-8abb-82a15c972899 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:51.395990 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794e43c-d488-42ad-8abb-82a15c972899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:51.404168 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e598a07-a4e5-4d01-899a-9fac4e32d4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:51.405067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e598a07-a4e5-4d01-899a-9fac4e32d4d3 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:51.405346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e598a07-a4e5-4d01-899a-9fac4e32d4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:51.405618 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e598a07-a4e5-4d01-899a-9fac4e32d4d3 None admin] PATH_INFO: `/v3/users/70d6459bcbb645d3b7985a3536ad2688` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:51.415068 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-8794e43c-d488-42ad-8abb-82a15c972899 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:51.416535 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-8794e43c-d488-42ad-8abb-82a15c972899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:51.422649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e598a07-a4e5-4d01-899a-9fac4e32d4d3 None admin] RBAC: Authorizing `identity:get_user(user_id=70d6459bcbb645d3b7985a3536ad2688)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:51.424276 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e598a07-a4e5-4d01-899a-9fac4e32d4d3 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:51.426467 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 106/218] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:51 2022] GET /identity/v3/users/70d6459bcbb645d3b7985a3536ad2688 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:51.433481 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e598a07-a4e5-4d01-899a-9fac4e32d4d3 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:51.505103 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 113/219] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:51.530923 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794e43c-d488-42ad-8abb-82a15c972899 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:51.561869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e598a07-a4e5-4d01-899a-9fac4e32d4d3 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:51.601246 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07999b04-a2aa-4bd1-b354-a8b2eab1db42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:51.604071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07999b04-a2aa-4bd1-b354-a8b2eab1db42 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:51.604071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07999b04-a2aa-4bd1-b354-a8b2eab1db42 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:51.604071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07999b04-a2aa-4bd1-b354-a8b2eab1db42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:51.655968 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794e43c-d488-42ad-8abb-82a15c972899 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:51.691184 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07999b04-a2aa-4bd1-b354-a8b2eab1db42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:51.691878 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430570c7-3e82-4542-9194-6cb8e673d32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:51.693749 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430570c7-3e82-4542-9194-6cb8e673d32a None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:51.693854 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07999b04-a2aa-4bd1-b354-a8b2eab1db42 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:51.693927 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430570c7-3e82-4542-9194-6cb8e673d32a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:51.693927 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430570c7-3e82-4542-9194-6cb8e673d32a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:51.706519 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430570c7-3e82-4542-9194-6cb8e673d32a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-430570c7-3e82-4542-9194-6cb8e673d32a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:51.715586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:51.716511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:51.717286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:51.717286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:51.717286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:51.717286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:51.717286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:51.717286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:51.717286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:51.717286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:51.717286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:51.717286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:51.717286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:51.717286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 19:59:51.719938 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 114/220] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 19:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 19:59:51.721424 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1052278-c0e5-4da7-8654-654eb0c4c5e7 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:51.722128 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1052278-c0e5-4da7-8654-654eb0c4c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:51.722795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1052278-c0e5-4da7-8654-654eb0c4c5e7 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:51.724528 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 115/221] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:51.725429 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1052278-c0e5-4da7-8654-654eb0c4c5e7 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:51.809928 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 107/222] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 19:59:51.811168 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411689cd-76af-4bd4-a179-c9b3c8c790b5 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:51.811459 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411689cd-76af-4bd4-a179-c9b3c8c790b5 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:51.811735 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411689cd-76af-4bd4-a179-c9b3c8c790b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:51.828734 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-411689cd-76af-4bd4-a179-c9b3c8c790b5 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:51.829920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-411689cd-76af-4bd4-a179-c9b3c8c790b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:51.838417 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1052278-c0e5-4da7-8654-654eb0c4c5e7 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:51.875852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c510b-49eb-40ed-9ae9-d5bd4513d97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:51.876984 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c510b-49eb-40ed-9ae9-d5bd4513d97f None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:51.877518 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c510b-49eb-40ed-9ae9-d5bd4513d97f None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:51.878011 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c510b-49eb-40ed-9ae9-d5bd4513d97f None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:51.878961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c510b-49eb-40ed-9ae9-d5bd4513d97f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:51.879461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c510b-49eb-40ed-9ae9-d5bd4513d97f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:51.881237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c510b-49eb-40ed-9ae9-d5bd4513d97f None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:51.895009 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 116/223] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:51.896637 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c510b-49eb-40ed-9ae9-d5bd4513d97f None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:51.905716 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 108/224] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:51.906558 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411689cd-76af-4bd4-a179-c9b3c8c790b5 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:52.001066 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c510b-49eb-40ed-9ae9-d5bd4513d97f None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:52.003362 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411689cd-76af-4bd4-a179-c9b3c8c790b5 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:52.035822 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53591b53-a1f6-4eda-b978-dfec1659043b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:52.036395 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666eff2f-79eb-47c7-81ea-c03877c7ec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:52.037272 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666eff2f-79eb-47c7-81ea-c03877c7ec33 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:52.037496 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53591b53-a1f6-4eda-b978-dfec1659043b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:52.037596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666eff2f-79eb-47c7-81ea-c03877c7ec33 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:52.037813 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666eff2f-79eb-47c7-81ea-c03877c7ec33 None admin] PATH_INFO: `/v3/users/40814dda8a7e441db83244192255d631` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:52.038280 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53591b53-a1f6-4eda-b978-dfec1659043b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:52.038743 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53591b53-a1f6-4eda-b978-dfec1659043b None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:52.039524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666eff2f-79eb-47c7-81ea-c03877c7ec33 None admin] RBAC: Authorizing `identity:get_user(user_id=40814dda8a7e441db83244192255d631)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:52.040924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53591b53-a1f6-4eda-b978-dfec1659043b None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:52.041137 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666eff2f-79eb-47c7-81ea-c03877c7ec33 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:52.042871 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53591b53-a1f6-4eda-b978-dfec1659043b None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:52.042979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 109/225] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:51 2022] GET /identity/v3/users/40814dda8a7e441db83244192255d631 => generated 283 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:52.043759 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666eff2f-79eb-47c7-81ea-c03877c7ec33 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:52.045377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 117/226] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:51 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:52.047818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53591b53-a1f6-4eda-b978-dfec1659043b None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:52.141379 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666eff2f-79eb-47c7-81ea-c03877c7ec33 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:52.150717 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53591b53-a1f6-4eda-b978-dfec1659043b None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:52.176312 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c3ee3-24b8-4069-837c-6dfc8363ba03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:52.177158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c3ee3-24b8-4069-837c-6dfc8363ba03 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:52.177448 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c3ee3-24b8-4069-837c-6dfc8363ba03 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:52.177699 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c3ee3-24b8-4069-837c-6dfc8363ba03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:52.188276 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c3ee3-24b8-4069-837c-6dfc8363ba03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:52.196783 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9a289-ef73-47eb-bead-ae0c05dd4ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-f31c3ee3-24b8-4069-837c-6dfc8363ba03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:52.197081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:52.197926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:52.198725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:52.198725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:52.198725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:52.198725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:52.198725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:52.198725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:52.198725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:52.198725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:52.198725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:52.198725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:52.198725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 19:59:52.198725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:52.198725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 110/227] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 19:59:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:52.199386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c3ee3-24b8-4069-837c-6dfc8363ba03 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:52.200878 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9a289-ef73-47eb-bead-ae0c05dd4ac9 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:52.201379 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9a289-ef73-47eb-bead-ae0c05dd4ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:52.201921 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9a289-ef73-47eb-bead-ae0c05dd4ac9 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:52.203660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9a289-ef73-47eb-bead-ae0c05dd4ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:52.205390 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9a289-ef73-47eb-bead-ae0c05dd4ac9 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:52.207648 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 118/228] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:52 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:52.208736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9a289-ef73-47eb-bead-ae0c05dd4ac9 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:52.300273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c3ee3-24b8-4069-837c-6dfc8363ba03 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:52.318364 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9a289-ef73-47eb-bead-ae0c05dd4ac9 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:52.333756 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d08750-0e02-4064-801a-63d76dfff878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:52.334413 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d08750-0e02-4064-801a-63d76dfff878 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:52.334693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d08750-0e02-4064-801a-63d76dfff878 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:52.334966 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d08750-0e02-4064-801a-63d76dfff878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:52.336405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d08750-0e02-4064-801a-63d76dfff878 None admin] RBAC: Adding query filter params (role.id=a2a640f930c44b2fa40f432179d7faa4, scope.project.id=68ea978bc82b479ea618aa819bb351fc, user.id=70d6459bcbb645d3b7985a3536ad2688) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:52.341779 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d08750-0e02-4064-801a-63d76dfff878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:52.341779 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d08750-0e02-4064-801a-63d76dfff878 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:52.343912 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 111/229] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:52 2022] GET /identity/v3/role_assignments?user.id=70d6459bcbb645d3b7985a3536ad2688&scope.project.id=68ea978bc82b479ea618aa819bb351fc&role.id=a2a640f930c44b2fa40f432179d7faa4 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:52.344736 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d08750-0e02-4064-801a-63d76dfff878 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:52.366441 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d26c41-4a94-490f-b6aa-99d812f3df14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:52.367175 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d26c41-4a94-490f-b6aa-99d812f3df14 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:52.367456 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d26c41-4a94-490f-b6aa-99d812f3df14 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:52.367726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d26c41-4a94-490f-b6aa-99d812f3df14 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:52.368578 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d26c41-4a94-490f-b6aa-99d812f3df14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:52.368885 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d26c41-4a94-490f-b6aa-99d812f3df14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:52.370365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d26c41-4a94-490f-b6aa-99d812f3df14 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:52.391290 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 119/230] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 19:59:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:52.399166 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d26c41-4a94-490f-b6aa-99d812f3df14 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:52.452220 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d08750-0e02-4064-801a-63d76dfff878 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:52.488237 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d96f7-54d4-442d-8621-39044adb598d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:52.489140 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d96f7-54d4-442d-8621-39044adb598d None admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:52.489420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d96f7-54d4-442d-8621-39044adb598d None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:52.489693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d96f7-54d4-442d-8621-39044adb598d None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc/users/40814dda8a7e441db83244192255d631/roles/5255ed3fa613448fb4c549f5bc7f20af` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:52.491765 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d96f7-54d4-442d-8621-39044adb598d None admin] RBAC: Authorizing `identity:create_grant(project_id=68ea978bc82b479ea618aa819bb351fc, user_id=40814dda8a7e441db83244192255d631, role_id=5255ed3fa613448fb4c549f5bc7f20af)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:52.493821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d96f7-54d4-442d-8621-39044adb598d None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:52.562929 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d26c41-4a94-490f-b6aa-99d812f3df14 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:52.599414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a736ab7-1053-4c4f-9ffe-c977f029ff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:52.600376 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a736ab7-1053-4c4f-9ffe-c977f029ff52 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:52.600655 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a736ab7-1053-4c4f-9ffe-c977f029ff52 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:52.600933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a736ab7-1053-4c4f-9ffe-c977f029ff52 None admin] PATH_INFO: `/v3/users/40814dda8a7e441db83244192255d631` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:52.602793 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a736ab7-1053-4c4f-9ffe-c977f029ff52 None admin] RBAC: Authorizing `identity:get_user(user_id=40814dda8a7e441db83244192255d631)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:52.602927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 112/231] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 19:59:52 2022] PUT /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc/users/40814dda8a7e441db83244192255d631/roles/5255ed3fa613448fb4c549f5bc7f20af => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 19:59:52.604293 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a736ab7-1053-4c4f-9ffe-c977f029ff52 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:52.606221 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 120/232] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:52 2022] GET /identity/v3/users/40814dda8a7e441db83244192255d631 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:52.612812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d96f7-54d4-442d-8621-39044adb598d None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:52.762701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d96f7-54d4-442d-8621-39044adb598d None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:52.803311 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cab11-379a-443b-a118-9d3948d65408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:52.804311 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cab11-379a-443b-a118-9d3948d65408 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:52.805231 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cab11-379a-443b-a118-9d3948d65408 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:52.805511 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cab11-379a-443b-a118-9d3948d65408 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:52.806786 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cab11-379a-443b-a118-9d3948d65408 None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:52.808311 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cab11-379a-443b-a118-9d3948d65408 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:52.811416 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 113/233] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:52 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:52.817128 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a736ab7-1053-4c4f-9ffe-c977f029ff52 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:52.942164 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a736ab7-1053-4c4f-9ffe-c977f029ff52 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:52.980595 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d1979-66a5-43ae-976a-6e57e42e3b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:52.992429 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d1979-66a5-43ae-976a-6e57e42e3b57 None admin] REQUEST_METHOD: `PUT` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:52.992429 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d1979-66a5-43ae-976a-6e57e42e3b57 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:52.992429 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d1979-66a5-43ae-976a-6e57e42e3b57 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc/users/40814dda8a7e441db83244192255d631/roles/9487c6d4fd524d9bae767533a1315b15` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:52.992429 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d1979-66a5-43ae-976a-6e57e42e3b57 None admin] RBAC: Authorizing `identity:create_grant(project_id=68ea978bc82b479ea618aa819bb351fc, user_id=40814dda8a7e441db83244192255d631, role_id=9487c6d4fd524d9bae767533a1315b15)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:52.992429 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d1979-66a5-43ae-976a-6e57e42e3b57 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:53.115908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 121/234] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 19:59:52 2022] PUT /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc/users/40814dda8a7e441db83244192255d631/roles/9487c6d4fd524d9bae767533a1315b15 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 19:59:53.994080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4543c1-a267-4641-a176-34a6eefdd1e2 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:53.994628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4543c1-a267-4641-a176-34a6eefdd1e2 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:53.994628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4543c1-a267-4641-a176-34a6eefdd1e2 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:53.996380 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 114/235] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:54.001557 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e4c01-46f0-4b54-97a4-ad03ae36d243 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:54.001955 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e4c01-46f0-4b54-97a4-ad03ae36d243 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:54.002133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e4c01-46f0-4b54-97a4-ad03ae36d243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:54.022768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-0b7e4c01-46f0-4b54-97a4-ad03ae36d243 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:54.024555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-0b7e4c01-46f0-4b54-97a4-ad03ae36d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:54.105860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 122/236] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:54.149377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4543c1-a267-4641-a176-34a6eefdd1e2 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:54.165627 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55145497-0b22-423b-80bd-c5e616977a13 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:54.165910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55145497-0b22-423b-80bd-c5e616977a13 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:54.166179 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55145497-0b22-423b-80bd-c5e616977a13 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:54.167548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 123/237] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 19:59:54.184988 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374c19c-8940-474a-b487-ecd8ffca33bb None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:54.185262 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374c19c-8940-474a-b487-ecd8ffca33bb None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:54.185523 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374c19c-8940-474a-b487-ecd8ffca33bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:54.215847 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-a374c19c-8940-474a-b487-ecd8ffca33bb None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:54.217067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-a374c19c-8940-474a-b487-ecd8ffca33bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:54.318107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4543c1-a267-4641-a176-34a6eefdd1e2 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:54.378087 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 124/238] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:54.395368 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d01173-58d2-44e6-8ef0-118c7c1164d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:54.396253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d01173-58d2-44e6-8ef0-118c7c1164d8 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:54.396539 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d01173-58d2-44e6-8ef0-118c7c1164d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:54.396861 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d01173-58d2-44e6-8ef0-118c7c1164d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:54.404290 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374c19c-8940-474a-b487-ecd8ffca33bb None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:54.422808 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d01173-58d2-44e6-8ef0-118c7c1164d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-48d01173-58d2-44e6-8ef0-118c7c1164d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:54.438807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:54.439689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:54.440572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:54.440572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:54.440572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:54.440572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:54.440572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:54.440572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:54.440572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:54.440572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:54.440572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:54.440572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:54.440572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 19:59:54.440572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:54.440572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 115/239] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:54.446123 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d01173-58d2-44e6-8ef0-118c7c1164d8 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:54.514231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374c19c-8940-474a-b487-ecd8ffca33bb None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:54.553204 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec9ea3-1c94-436f-8d41-055776a0a423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:54.554019 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec9ea3-1c94-436f-8d41-055776a0a423 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:54.554301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec9ea3-1c94-436f-8d41-055776a0a423 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:54.554621 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec9ea3-1c94-436f-8d41-055776a0a423 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:54.555827 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec9ea3-1c94-436f-8d41-055776a0a423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:54.557698 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec9ea3-1c94-436f-8d41-055776a0a423 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:54.559825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 125/240] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 19:59:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:54.565168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec9ea3-1c94-436f-8d41-055776a0a423 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:54.652311 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d01173-58d2-44e6-8ef0-118c7c1164d8 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:54.703435 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec9ea3-1c94-436f-8d41-055776a0a423 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:54.737648 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65577741-9197-4e97-bc05-114d6c9a7108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:54.738678 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65577741-9197-4e97-bc05-114d6c9a7108 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:54.739126 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65577741-9197-4e97-bc05-114d6c9a7108 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:54.739542 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65577741-9197-4e97-bc05-114d6c9a7108 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:54.740465 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65577741-9197-4e97-bc05-114d6c9a7108 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:54.740922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65577741-9197-4e97-bc05-114d6c9a7108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:54.741766 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2427b96-2984-429f-b9c8-57b0bd18af49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:54.742421 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65577741-9197-4e97-bc05-114d6c9a7108 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:54.742960 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2427b96-2984-429f-b9c8-57b0bd18af49 None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:54.743434 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2427b96-2984-429f-b9c8-57b0bd18af49 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:54.744106 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2427b96-2984-429f-b9c8-57b0bd18af49 None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:54.745015 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2427b96-2984-429f-b9c8-57b0bd18af49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:54.746662 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2427b96-2984-429f-b9c8-57b0bd18af49 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:54.763625 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 116/241] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 19:59:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:54.769559 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65577741-9197-4e97-bc05-114d6c9a7108 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:54.859086 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 126/242] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Apr 29 19:59:54 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 19:59:54.890074 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65577741-9197-4e97-bc05-114d6c9a7108 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:54.928536 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af275153-b09a-46e3-9651-23125bc934f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:54.929814 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af275153-b09a-46e3-9651-23125bc934f8 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:54.930317 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af275153-b09a-46e3-9651-23125bc934f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:54.930817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af275153-b09a-46e3-9651-23125bc934f8 None admin] PATH_INFO: `/v3/users/d8aa1246302e46efb44e3ffa814539ef` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:54.946976 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af275153-b09a-46e3-9651-23125bc934f8 None admin] RBAC: Authorizing `identity:get_user(user_id=d8aa1246302e46efb44e3ffa814539ef)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:54.948890 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af275153-b09a-46e3-9651-23125bc934f8 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:54.951455 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 117/243] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:54 2022] GET /identity/v3/users/d8aa1246302e46efb44e3ffa814539ef => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:54.956970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2427b96-2984-429f-b9c8-57b0bd18af49 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:54.971776 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb940ba-91f9-4706-9a8f-a649bd753bd7 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:54.972329 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb940ba-91f9-4706-9a8f-a649bd753bd7 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:54.972760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb940ba-91f9-4706-9a8f-a649bd753bd7 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:54.974953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 118/244] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:54.983567 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64a34c-7117-4370-be70-f576b31a7659 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:54.984143 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64a34c-7117-4370-be70-f576b31a7659 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:54.985094 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64a34c-7117-4370-be70-f576b31a7659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:55.027193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-fb64a34c-7117-4370-be70-f576b31a7659 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:55.028508 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-fb64a34c-7117-4370-be70-f576b31a7659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:55.098580 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2427b96-2984-429f-b9c8-57b0bd18af49 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:55.135914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c63ec-dcc7-4c7c-9c7b-f87a9599c0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:55.139752 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 119/245] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:55.140819 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c63ec-dcc7-4c7c-9c7b-f87a9599c0e5 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:55.141303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c63ec-dcc7-4c7c-9c7b-f87a9599c0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:55.141758 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c63ec-dcc7-4c7c-9c7b-f87a9599c0e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:55.198416 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64a34c-7117-4370-be70-f576b31a7659 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:55.224130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c63ec-dcc7-4c7c-9c7b-f87a9599c0e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:55.225872 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c63ec-dcc7-4c7c-9c7b-f87a9599c0e5 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:55.304252 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64a34c-7117-4370-be70-f576b31a7659 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:55.334707 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 127/246] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 19:59:55.336750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c63ec-dcc7-4c7c-9c7b-f87a9599c0e5 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:55.356263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ea778-add2-4264-9c72-8f120093b511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:55.357488 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ea778-add2-4264-9c72-8f120093b511 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:55.357975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ea778-add2-4264-9c72-8f120093b511 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:55.358450 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ea778-add2-4264-9c72-8f120093b511 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:55.372529 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ea778-add2-4264-9c72-8f120093b511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-8d6ea778-add2-4264-9c72-8f120093b511 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:55.382038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:55.383080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:55.383993 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:55.383993 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:55.383993 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:55.383993 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:55.383993 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:55.383993 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:55.383993 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:55.383993 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:55.383993 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:55.383993 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:55.383993 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:55.383993 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:55.386810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 120/247] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:55.392707 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ea778-add2-4264-9c72-8f120093b511 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:55.445279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c63ec-dcc7-4c7c-9c7b-f87a9599c0e5 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:55.481332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7768d42-1fc8-4820-95a7-5db3ea77c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:55.482115 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7768d42-1fc8-4820-95a7-5db3ea77c19e None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:55.482394 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7768d42-1fc8-4820-95a7-5db3ea77c19e None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:55.482665 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7768d42-1fc8-4820-95a7-5db3ea77c19e None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:55.483874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7768d42-1fc8-4820-95a7-5db3ea77c19e None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:55.485528 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7768d42-1fc8-4820-95a7-5db3ea77c19e None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:55.487091 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 128/248] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:55 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:55.492972 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7768d42-1fc8-4820-95a7-5db3ea77c19e None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:55.498446 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ea778-add2-4264-9c72-8f120093b511 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:55.534247 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d51be-9547-4d8a-8e00-77b06b1d36a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:55.535320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d51be-9547-4d8a-8e00-77b06b1d36a3 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:55.535893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d51be-9547-4d8a-8e00-77b06b1d36a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:55.536390 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d51be-9547-4d8a-8e00-77b06b1d36a3 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:55.537353 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d51be-9547-4d8a-8e00-77b06b1d36a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:55.537858 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d51be-9547-4d8a-8e00-77b06b1d36a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:55.540151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d51be-9547-4d8a-8e00-77b06b1d36a3 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:55.549012 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 121/249] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 19:59:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:55.555810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d51be-9547-4d8a-8e00-77b06b1d36a3 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:55.596486 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7768d42-1fc8-4820-95a7-5db3ea77c19e None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:55.641511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930886a3-09e2-4edd-9ed8-8cdcb8c948ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:55.642172 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930886a3-09e2-4edd-9ed8-8cdcb8c948ce None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:55.642452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930886a3-09e2-4edd-9ed8-8cdcb8c948ce None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:55.642725 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930886a3-09e2-4edd-9ed8-8cdcb8c948ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:55.643554 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930886a3-09e2-4edd-9ed8-8cdcb8c948ce None admin] RBAC: Adding query filter params (role.id=a82cefb7fdd14179a308031eb40d7e48, scope.project.id=68ea978bc82b479ea618aa819bb351fc, user.id=d8aa1246302e46efb44e3ffa814539ef) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:55.643863 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930886a3-09e2-4edd-9ed8-8cdcb8c948ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:55.645804 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930886a3-09e2-4edd-9ed8-8cdcb8c948ce None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:55.651447 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 129/250] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:55 2022] GET /identity/v3/role_assignments?user.id=d8aa1246302e46efb44e3ffa814539ef&scope.project.id=68ea978bc82b479ea618aa819bb351fc&role.id=a82cefb7fdd14179a308031eb40d7e48 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:55.653827 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee668582-99e8-4875-a67f-6c2b4df3ebd4 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:55.654332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee668582-99e8-4875-a67f-6c2b4df3ebd4 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:55.654745 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee668582-99e8-4875-a67f-6c2b4df3ebd4 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:55.656285 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 130/251] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:55.662878 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce51c4-4508-42a2-b8d4-36e5741eca80 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:55.663173 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce51c4-4508-42a2-b8d4-36e5741eca80 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:55.663417 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce51c4-4508-42a2-b8d4-36e5741eca80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:55.676456 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d51be-9547-4d8a-8e00-77b06b1d36a3 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:55.698192 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-f0ce51c4-4508-42a2-b8d4-36e5741eca80 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:55.699432 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-f0ce51c4-4508-42a2-b8d4-36e5741eca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:55.719431 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c69801-ab9c-4a15-91bf-b153350eea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:55.720732 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c69801-ab9c-4a15-91bf-b153350eea6e None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:55.721221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c69801-ab9c-4a15-91bf-b153350eea6e None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:55.721716 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c69801-ab9c-4a15-91bf-b153350eea6e None admin] PATH_INFO: `/v3/users/70d6459bcbb645d3b7985a3536ad2688` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:55.723822 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c69801-ab9c-4a15-91bf-b153350eea6e None admin] RBAC: Authorizing `identity:get_user(user_id=70d6459bcbb645d3b7985a3536ad2688)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:55.725601 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c69801-ab9c-4a15-91bf-b153350eea6e None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:55.728111 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 122/252] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:55 2022] GET /identity/v3/users/70d6459bcbb645d3b7985a3536ad2688 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:55.737347 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c69801-ab9c-4a15-91bf-b153350eea6e None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:55.836906 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 131/253] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:55.875649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c69801-ab9c-4a15-91bf-b153350eea6e None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:55.906565 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce51c4-4508-42a2-b8d4-36e5741eca80 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:55.922594 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7d93e-0164-488b-aa82-759f702b791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:55.923237 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7d93e-0164-488b-aa82-759f702b791e None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:55.923516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7d93e-0164-488b-aa82-759f702b791e None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:55.923797 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7d93e-0164-488b-aa82-759f702b791e None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:55.926169 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7d93e-0164-488b-aa82-759f702b791e None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:55.927638 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7d93e-0164-488b-aa82-759f702b791e None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:55.931178 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 123/254] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:55 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:55.935295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7d93e-0164-488b-aa82-759f702b791e None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:56.082702 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce51c4-4508-42a2-b8d4-36e5741eca80 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:56.166928 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7d93e-0164-488b-aa82-759f702b791e None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:56.195767 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21801c-0295-4fa3-bd01-608e61786b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:56.196596 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21801c-0295-4fa3-bd01-608e61786b30 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:56.196862 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21801c-0295-4fa3-bd01-608e61786b30 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:56.197132 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21801c-0295-4fa3-bd01-608e61786b30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:56.214892 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f8ab8-926b-4973-b3e8-26d64c2819f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:56.215787 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f8ab8-926b-4973-b3e8-26d64c2819f9 None admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:56.216097 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f8ab8-926b-4973-b3e8-26d64c2819f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:56.216370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f8ab8-926b-4973-b3e8-26d64c2819f9 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc/users/70d6459bcbb645d3b7985a3536ad2688/roles/a2a640f930c44b2fa40f432179d7faa4` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:56.218361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f8ab8-926b-4973-b3e8-26d64c2819f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=68ea978bc82b479ea618aa819bb351fc, user_id=70d6459bcbb645d3b7985a3536ad2688, role_id=a2a640f930c44b2fa40f432179d7faa4)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:56.219819 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f8ab8-926b-4973-b3e8-26d64c2819f9 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:56.228610 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21801c-0295-4fa3-bd01-608e61786b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-2e21801c-0295-4fa3-bd01-608e61786b30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:56.236642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:56.242642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:56.243726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:56.243726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:56.243726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:56.243726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:56.243726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:56.243726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:56.243726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:56.243726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:56.243726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:56.243726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:56.243726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 19:59:56.243726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 19:59:56.243726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 132/255] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 19:59:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:56.244408 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21801c-0295-4fa3-bd01-608e61786b30 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:56.334186 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 124/256] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 19:59:55 2022] PUT /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc/users/70d6459bcbb645d3b7985a3536ad2688/roles/a2a640f930c44b2fa40f432179d7faa4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 19:59:56.338265 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90544511-0335-436c-9792-17c3d1051629 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:56.338945 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90544511-0335-436c-9792-17c3d1051629 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:56.339432 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90544511-0335-436c-9792-17c3d1051629 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:56.343886 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 125/257] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:56.352311 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ce108-eb3e-4f24-8c2a-33f24cfcee14 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:56.355622 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ce108-eb3e-4f24-8c2a-33f24cfcee14 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:56.355622 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ce108-eb3e-4f24-8c2a-33f24cfcee14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:56.383786 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-a99ce108-eb3e-4f24-8c2a-33f24cfcee14 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:56.385125 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-a99ce108-eb3e-4f24-8c2a-33f24cfcee14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:56.393765 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21801c-0295-4fa3-bd01-608e61786b30 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:56.455703 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef9746-5496-4f36-af36-84fd0352b006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:56.456504 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef9746-5496-4f36-af36-84fd0352b006 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:56.456724 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef9746-5496-4f36-af36-84fd0352b006 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:56.457045 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef9746-5496-4f36-af36-84fd0352b006 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:56.457807 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef9746-5496-4f36-af36-84fd0352b006 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:56.458121 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef9746-5496-4f36-af36-84fd0352b006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:56.459615 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef9746-5496-4f36-af36-84fd0352b006 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:56.469268 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 133/258] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:56.475350 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef9746-5496-4f36-af36-84fd0352b006 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:56.525451 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 126/259] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:56.602685 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef9746-5496-4f36-af36-84fd0352b006 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:56.631543 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ce108-eb3e-4f24-8c2a-33f24cfcee14 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:56.651938 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97784-b40a-4c50-8fc5-46030b5fbdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:56.652846 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97784-b40a-4c50-8fc5-46030b5fbdb6 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:56.653128 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97784-b40a-4c50-8fc5-46030b5fbdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:56.653399 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97784-b40a-4c50-8fc5-46030b5fbdb6 None admin] PATH_INFO: `/v3/users/40814dda8a7e441db83244192255d631` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:56.658003 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab97784-b40a-4c50-8fc5-46030b5fbdb6 None admin] RBAC: Authorizing `identity:get_user(user_id=40814dda8a7e441db83244192255d631)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:56.659492 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab97784-b40a-4c50-8fc5-46030b5fbdb6 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:56.661623 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 134/260] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:56 2022] GET /identity/v3/users/40814dda8a7e441db83244192255d631 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:56.667637 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97784-b40a-4c50-8fc5-46030b5fbdb6 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:56.810586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97784-b40a-4c50-8fc5-46030b5fbdb6 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:56.845988 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620975ff-af27-4246-a651-0798fdf58cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:56.846817 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620975ff-af27-4246-a651-0798fdf58cbd None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:56.847098 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620975ff-af27-4246-a651-0798fdf58cbd None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:56.847375 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620975ff-af27-4246-a651-0798fdf58cbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:56.863861 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ce108-eb3e-4f24-8c2a-33f24cfcee14 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:56.919456 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620975ff-af27-4246-a651-0798fdf58cbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:56.920998 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620975ff-af27-4246-a651-0798fdf58cbd None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:56.956716 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c14c6-92ce-4569-9404-4996f86bd1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:56.957547 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c14c6-92ce-4569-9404-4996f86bd1b8 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:56.957833 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c14c6-92ce-4569-9404-4996f86bd1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:56.958104 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c14c6-92ce-4569-9404-4996f86bd1b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:56.985099 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c14c6-92ce-4569-9404-4996f86bd1b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-e16c14c6-92ce-4569-9404-4996f86bd1b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:57.003084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:57.005211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:57.007096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:57.007096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:57.007096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:57.007096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:57.007096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:57.007096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:57.007096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:57.007096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:57.007096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:57.007096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:57.007096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 19:59:57.007096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:57.007096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 127/261] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 19:59:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 19:59:57.026343 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c14c6-92ce-4569-9404-4996f86bd1b8 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:57.031944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 135/262] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 29 19:59:57.037527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620975ff-af27-4246-a651-0798fdf58cbd None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:57.150556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620975ff-af27-4246-a651-0798fdf58cbd None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:57.185518 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5f576-cdb9-4fcf-ba7a-4cf30da9d3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:57.186380 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5f576-cdb9-4fcf-ba7a-4cf30da9d3f4 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:57.186692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5f576-cdb9-4fcf-ba7a-4cf30da9d3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:57.187105 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5f576-cdb9-4fcf-ba7a-4cf30da9d3f4 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:57.188319 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5f576-cdb9-4fcf-ba7a-4cf30da9d3f4 None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:57.189769 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5f576-cdb9-4fcf-ba7a-4cf30da9d3f4 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:57.191820 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 136/263] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:57 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:57.197277 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5f576-cdb9-4fcf-ba7a-4cf30da9d3f4 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:57.267191 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c14c6-92ce-4569-9404-4996f86bd1b8 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:57.335012 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f8c0-e685-4632-98e8-0950c1dc5a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:57.335716 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f8c0-e685-4632-98e8-0950c1dc5a4f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:57.336014 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f8c0-e685-4632-98e8-0950c1dc5a4f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:57.336296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f8c0-e685-4632-98e8-0950c1dc5a4f None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:57.337119 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9f8c0-e685-4632-98e8-0950c1dc5a4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:57.337430 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9f8c0-e685-4632-98e8-0950c1dc5a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:57.343133 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9f8c0-e685-4632-98e8-0950c1dc5a4f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:57.366231 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 128/264] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 19:59:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:57.374836 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5f576-cdb9-4fcf-ba7a-4cf30da9d3f4 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:57.387059 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f8c0-e685-4632-98e8-0950c1dc5a4f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:57.410051 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecee13-a1e4-4bcf-80f9-f8bcfb9e0da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:57.410635 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecee13-a1e4-4bcf-80f9-f8bcfb9e0da7 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:57.410916 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecee13-a1e4-4bcf-80f9-f8bcfb9e0da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:57.411192 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecee13-a1e4-4bcf-80f9-f8bcfb9e0da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:57.412065 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecee13-a1e4-4bcf-80f9-f8bcfb9e0da7 None admin] RBAC: Adding query filter params (role.id=5255ed3fa613448fb4c549f5bc7f20af, scope.project.id=68ea978bc82b479ea618aa819bb351fc, user.id=40814dda8a7e441db83244192255d631) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:57.412380 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecee13-a1e4-4bcf-80f9-f8bcfb9e0da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:57.414493 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecee13-a1e4-4bcf-80f9-f8bcfb9e0da7 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:57.421026 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 137/265] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:57 2022] GET /identity/v3/role_assignments?user.id=40814dda8a7e441db83244192255d631&scope.project.id=68ea978bc82b479ea618aa819bb351fc&role.id=5255ed3fa613448fb4c549f5bc7f20af => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:57.575357 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f8c0-e685-4632-98e8-0950c1dc5a4f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:57.620673 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb4f7d-5f61-4c26-94b9-37454de1a88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:57.621558 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4f7d-5f61-4c26-94b9-37454de1a88c None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:57.621840 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4f7d-5f61-4c26-94b9-37454de1a88c None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:57.622116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4f7d-5f61-4c26-94b9-37454de1a88c None admin] PATH_INFO: `/v3/users/40814dda8a7e441db83244192255d631` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:57.628868 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb4f7d-5f61-4c26-94b9-37454de1a88c None admin] RBAC: Authorizing `identity:get_user(user_id=40814dda8a7e441db83244192255d631)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:57.630352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb4f7d-5f61-4c26-94b9-37454de1a88c None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:57.632426 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 129/266] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:57 2022] GET /identity/v3/users/40814dda8a7e441db83244192255d631 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:57.637994 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecee13-a1e4-4bcf-80f9-f8bcfb9e0da7 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:57.773933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecee13-a1e4-4bcf-80f9-f8bcfb9e0da7 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:57.808663 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642b903-50b3-4461-b1d4-5ddc2dd6c2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:57.810007 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642b903-50b3-4461-b1d4-5ddc2dd6c2c0 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:57.810007 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642b903-50b3-4461-b1d4-5ddc2dd6c2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:57.810007 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642b903-50b3-4461-b1d4-5ddc2dd6c2c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:57.878918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642b903-50b3-4461-b1d4-5ddc2dd6c2c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:57.880427 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642b903-50b3-4461-b1d4-5ddc2dd6c2c0 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:57.981470 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 138/267] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 19:59:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 19:59:57.987153 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb4f7d-5f61-4c26-94b9-37454de1a88c None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:58.089861 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb4f7d-5f61-4c26-94b9-37454de1a88c None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:58.127604 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800db74d-1aac-42d3-83d1-21b485d06f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:58.128683 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800db74d-1aac-42d3-83d1-21b485d06f34 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:58.128962 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800db74d-1aac-42d3-83d1-21b485d06f34 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:58.129232 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800db74d-1aac-42d3-83d1-21b485d06f34 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:58.130483 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800db74d-1aac-42d3-83d1-21b485d06f34 None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:58.132001 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800db74d-1aac-42d3-83d1-21b485d06f34 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:58.134153 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 130/268] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:57 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:58.139886 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642b903-50b3-4461-b1d4-5ddc2dd6c2c0 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:58.272772 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642b903-50b3-4461-b1d4-5ddc2dd6c2c0 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:58.311439 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1c918-8e66-4737-bdce-1b10584fe54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:58.312127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1c918-8e66-4737-bdce-1b10584fe54b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:58.312410 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1c918-8e66-4737-bdce-1b10584fe54b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:58.312683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1c918-8e66-4737-bdce-1b10584fe54b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:58.313573 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1c918-8e66-4737-bdce-1b10584fe54b None admin] RBAC: Adding query filter params (role.id=9487c6d4fd524d9bae767533a1315b15, scope.project.id=68ea978bc82b479ea618aa819bb351fc, user.id=40814dda8a7e441db83244192255d631) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:58.313877 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1c918-8e66-4737-bdce-1b10584fe54b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:58.315367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1c918-8e66-4737-bdce-1b10584fe54b None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:58.322277 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 139/269] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 19:59:58 2022] GET /identity/v3/role_assignments?user.id=40814dda8a7e441db83244192255d631&scope.project.id=68ea978bc82b479ea618aa819bb351fc&role.id=9487c6d4fd524d9bae767533a1315b15 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:58.352854 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aa78b-7f67-4c29-9d73-5d0b0c7d36d1 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:58.353362 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aa78b-7f67-4c29-9d73-5d0b0c7d36d1 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:58.353435 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aa78b-7f67-4c29-9d73-5d0b0c7d36d1 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:58.355342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 131/270] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:58.361171 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5584e3-9daf-4b24-bb75-e2b9530f1c3f None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:58.361560 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5584e3-9daf-4b24-bb75-e2b9530f1c3f None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:58.361724 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5584e3-9daf-4b24-bb75-e2b9530f1c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:58.385185 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-5b5584e3-9daf-4b24-bb75-e2b9530f1c3f None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:58.386399 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-5b5584e3-9daf-4b24-bb75-e2b9530f1c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:58.470753 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 140/271] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:58.512077 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223aa78b-7f67-4c29-9d73-5d0b0c7d36d1 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:58.658621 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223aa78b-7f67-4c29-9d73-5d0b0c7d36d1 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:58.694794 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958f7cd-e830-4341-b90c-90ac558c883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:58.695625 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958f7cd-e830-4341-b90c-90ac558c883c None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:58.695902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958f7cd-e830-4341-b90c-90ac558c883c None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:58.696205 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958f7cd-e830-4341-b90c-90ac558c883c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:58.707688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958f7cd-e830-4341-b90c-90ac558c883c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-7958f7cd-e830-4341-b90c-90ac558c883c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:58.715739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:58.716697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:58.717490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:58.717490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:58.717490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:58.717490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:58.717490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:58.717490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:58.717490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:58.717490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:58.717490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:58.717490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:58.717490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:58.717490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 19:59:58.717490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 132/272] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:58.723192 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5584e3-9daf-4b24-bb75-e2b9530f1c3f None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:58.827434 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5584e3-9daf-4b24-bb75-e2b9530f1c3f None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:58.866182 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74359623-2da9-4e81-8786-7f8e6da73626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:58.867436 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74359623-2da9-4e81-8786-7f8e6da73626 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:58.867692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74359623-2da9-4e81-8786-7f8e6da73626 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:58.867968 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74359623-2da9-4e81-8786-7f8e6da73626 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:58.868747 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74359623-2da9-4e81-8786-7f8e6da73626 None admin] RBAC: Adding query filter params (name=member) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:58.869052 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74359623-2da9-4e81-8786-7f8e6da73626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:58.870512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74359623-2da9-4e81-8786-7f8e6da73626 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:58.879494 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 141/273] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 19:59:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:58.884698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958f7cd-e830-4341-b90c-90ac558c883c None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:58.993431 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958f7cd-e830-4341-b90c-90ac558c883c None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:59.030912 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf27bc4-20af-42ad-810e-2c8f59f82643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:59.031866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf27bc4-20af-42ad-810e-2c8f59f82643 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:59.032176 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf27bc4-20af-42ad-810e-2c8f59f82643 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:59.032452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf27bc4-20af-42ad-810e-2c8f59f82643 None admin] PATH_INFO: `/v3/users/fe2cf48c3a67413484816383bcdd708b` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:59.048354 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e2528-f3a0-42b9-8e0b-2c6f0a51fba3 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:59.048708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e2528-f3a0-42b9-8e0b-2c6f0a51fba3 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:59.048993 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e2528-f3a0-42b9-8e0b-2c6f0a51fba3 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:59.051439 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 142/274] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:59.053022 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf27bc4-20af-42ad-810e-2c8f59f82643 None admin] RBAC: Authorizing `identity:get_user(user_id=fe2cf48c3a67413484816383bcdd708b)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:59.054776 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf27bc4-20af-42ad-810e-2c8f59f82643 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:59.056672 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6c0b0-d76f-4d30-a5aa-8733ad6de828 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:59.056955 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6c0b0-d76f-4d30-a5aa-8733ad6de828 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:59.057234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6c0b0-d76f-4d30-a5aa-8733ad6de828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:59.059133 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 133/275] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:58 2022] GET /identity/v3/users/fe2cf48c3a67413484816383bcdd708b => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:59.062734 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf27bc4-20af-42ad-810e-2c8f59f82643 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:59.082637 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-82d6c0b0-d76f-4d30-a5aa-8733ad6de828 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:59.083822 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-82d6c0b0-d76f-4d30-a5aa-8733ad6de828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:59.154857 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 143/276] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:59.178178 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6c0b0-d76f-4d30-a5aa-8733ad6de828 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:59.184197 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf27bc4-20af-42ad-810e-2c8f59f82643 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:59.224808 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4ed4b-b339-4afe-b7e7-d9e70dabc431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:59.225467 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ed4b-b339-4afe-b7e7-d9e70dabc431 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:59.225747 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ed4b-b339-4afe-b7e7-d9e70dabc431 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:59.226023 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ed4b-b339-4afe-b7e7-d9e70dabc431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:59.227405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4ed4b-b339-4afe-b7e7-d9e70dabc431 None admin] RBAC: Adding query filter params (role.id=a2a640f930c44b2fa40f432179d7faa4, user.id=fe2cf48c3a67413484816383bcdd708b, scope.system=all) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:59.227716 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4ed4b-b339-4afe-b7e7-d9e70dabc431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:59.229194 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4ed4b-b339-4afe-b7e7-d9e70dabc431 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:59.234709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 134/277] 10.222.0.58 () {56 vars in 1308 bytes} [Fri Apr 29 19:59:59 2022] GET /identity/v3/role_assignments?user.id=fe2cf48c3a67413484816383bcdd708b&scope.system=all&role.id=a2a640f930c44b2fa40f432179d7faa4 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:59.240018 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca64991-8a8d-42c6-ab86-824a7085ca03 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:59.240018 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca64991-8a8d-42c6-ab86-824a7085ca03 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:59.240018 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca64991-8a8d-42c6-ab86-824a7085ca03 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:59.240018 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 135/278] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:59.249926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e7587-f203-49b4-93dc-fa6bfb1d9418 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:59.250222 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e7587-f203-49b4-93dc-fa6bfb1d9418 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:59.250570 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e7587-f203-49b4-93dc-fa6bfb1d9418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:59.271379 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-5a3e7587-f203-49b4-93dc-fa6bfb1d9418 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:59.274084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-5a3e7587-f203-49b4-93dc-fa6bfb1d9418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:59.291901 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6c0b0-d76f-4d30-a5aa-8733ad6de828 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:59.331171 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f07e51-eecd-4615-a2d4-2afa12cea54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:59.332442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f07e51-eecd-4615-a2d4-2afa12cea54e None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:59.332969 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f07e51-eecd-4615-a2d4-2afa12cea54e None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:59.333420 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f07e51-eecd-4615-a2d4-2afa12cea54e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:59.345543 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f07e51-eecd-4615-a2d4-2afa12cea54e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-a2f07e51-eecd-4615-a2d4-2afa12cea54e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:59.354869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:59.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:59.356708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:59.356708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:59.356708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:59.356708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:59.356708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:59.356708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:59.356708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:59.356708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:59.356708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:59.356708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:59.356708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 19:59:59.356708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 19:59:59.360738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 144/279] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 19:59:59.366461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f07e51-eecd-4615-a2d4-2afa12cea54e None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:59.380459 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 136/280] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 19:59:59.409164 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e7587-f203-49b4-93dc-fa6bfb1d9418 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:59.488523 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f07e51-eecd-4615-a2d4-2afa12cea54e None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:59.530519 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72f087-f8d3-4198-be5b-86ccbd2d39bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:59.531115 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72f087-f8d3-4198-be5b-86ccbd2d39bb None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:59.531399 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72f087-f8d3-4198-be5b-86ccbd2d39bb None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:59.531678 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72f087-f8d3-4198-be5b-86ccbd2d39bb None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:59.531951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e7587-f203-49b4-93dc-fa6bfb1d9418 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:59.532462 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72f087-f8d3-4198-be5b-86ccbd2d39bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 19:59:59.532772 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72f087-f8d3-4198-be5b-86ccbd2d39bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:59.535192 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72f087-f8d3-4198-be5b-86ccbd2d39bb None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:59.549417 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 145/281] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 19:59:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:59.549417 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fce67-8f11-493e-9c6c-99edb0c0967e None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:59.549417 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fce67-8f11-493e-9c6c-99edb0c0967e None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:59.549417 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fce67-8f11-493e-9c6c-99edb0c0967e None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:59.550079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 146/282] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 19:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 19:59:59.551061 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fce67-8f11-493e-9c6c-99edb0c0967e None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:59.566082 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e833843-b169-4a56-a669-98a456239b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:59.566987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e833843-b169-4a56-a669-98a456239b82 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:59.567274 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e833843-b169-4a56-a669-98a456239b82 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:59.567552 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e833843-b169-4a56-a669-98a456239b82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:59.568733 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e833843-b169-4a56-a669-98a456239b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:59.570737 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e833843-b169-4a56-a669-98a456239b82 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:59.572637 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 137/283] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 19:59:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 19:59:59.573602 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660c89d-b5ee-4d98-b4a5-f20c20b52e22 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:59.573886 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660c89d-b5ee-4d98-b4a5-f20c20b52e22 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:59.574159 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660c89d-b5ee-4d98-b4a5-f20c20b52e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:59.594336 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-4660c89d-b5ee-4d98-b4a5-f20c20b52e22 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 19:59:59.595501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-4660c89d-b5ee-4d98-b4a5-f20c20b52e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 19:59:59.660339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 138/284] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 19:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 19:59:59.660999 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660c89d-b5ee-4d98-b4a5-f20c20b52e22 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:59.671028 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fce67-8f11-493e-9c6c-99edb0c0967e None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:59.709449 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af88ef-944a-4364-a3ef-78dcd0572d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:59.710327 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af88ef-944a-4364-a3ef-78dcd0572d6a None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:59.710634 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af88ef-944a-4364-a3ef-78dcd0572d6a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:59.710905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af88ef-944a-4364-a3ef-78dcd0572d6a None admin] PATH_INFO: `/v3/users/d8aa1246302e46efb44e3ffa814539ef` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:59.712107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af88ef-944a-4364-a3ef-78dcd0572d6a None admin] RBAC: Authorizing `identity:get_user(user_id=d8aa1246302e46efb44e3ffa814539ef)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:59.713553 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af88ef-944a-4364-a3ef-78dcd0572d6a None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:59.719683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 147/285] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 19:59:59 2022] GET /identity/v3/users/d8aa1246302e46efb44e3ffa814539ef => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 19:59:59.719683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af88ef-944a-4364-a3ef-78dcd0572d6a None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:59.764667 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660c89d-b5ee-4d98-b4a5-f20c20b52e22 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:59.798468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee8dfe-4d2b-43a5-89eb-afe1503ff046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:59.799052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee8dfe-4d2b-43a5-89eb-afe1503ff046 None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:59.799334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee8dfe-4d2b-43a5-89eb-afe1503ff046 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:59.799608 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee8dfe-4d2b-43a5-89eb-afe1503ff046 None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:59.800397 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee8dfe-4d2b-43a5-89eb-afe1503ff046 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 19:59:59.801915 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee8dfe-4d2b-43a5-89eb-afe1503ff046 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 19:59:59.812360 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af88ef-944a-4364-a3ef-78dcd0572d6a None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 19:59:59.844147 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed11bef-9b7c-42db-9b83-b3137a43cf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 19:59:59.844930 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed11bef-9b7c-42db-9b83-b3137a43cf0c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 19:59:59.845204 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed11bef-9b7c-42db-9b83-b3137a43cf0c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 19:59:59.845470 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed11bef-9b7c-42db-9b83-b3137a43cf0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 19:59:59.855428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed11bef-9b7c-42db-9b83-b3137a43cf0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-8ed11bef-9b7c-42db-9b83-b3137a43cf0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 19:59:59.863133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 19:59:59.864428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 19:59:59.865266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 19:59:59.865266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 19:59:59.865266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 19:59:59.865266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 19:59:59.865266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 19:59:59.865266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 19:59:59.865266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 19:59:59.865266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 19:59:59.865266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 19:59:59.865266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 19:59:59.865266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 19:59:59.865266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 19:59:59.865266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 148/286] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 19:59:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 19:59:59.865266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed11bef-9b7c-42db-9b83-b3137a43cf0c None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:59.925189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 139/287] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Apr 29 19:59:59 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 19:59:59.934716 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee8dfe-4d2b-43a5-89eb-afe1503ff046 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 19:59:59.970432 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed11bef-9b7c-42db-9b83-b3137a43cf0c None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:00.009784 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef393a-dcfc-49a7-9b81-bc4bdb97aa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:00.010671 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef393a-dcfc-49a7-9b81-bc4bdb97aa06 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:00.011004 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef393a-dcfc-49a7-9b81-bc4bdb97aa06 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:00.011344 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef393a-dcfc-49a7-9b81-bc4bdb97aa06 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:00.012843 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef393a-dcfc-49a7-9b81-bc4bdb97aa06 None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:00.014351 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef393a-dcfc-49a7-9b81-bc4bdb97aa06 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:00.020800 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 149/288] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 19:59:59 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:00.022189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef393a-dcfc-49a7-9b81-bc4bdb97aa06 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:00.089988 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee8dfe-4d2b-43a5-89eb-afe1503ff046 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:00.138866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef393a-dcfc-49a7-9b81-bc4bdb97aa06 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:00.142333 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf511ed5-1caa-4c9f-89a3-6a4773cba7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:00.143195 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf511ed5-1caa-4c9f-89a3-6a4773cba7c6 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:00.143618 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf511ed5-1caa-4c9f-89a3-6a4773cba7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:00.144058 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf511ed5-1caa-4c9f-89a3-6a4773cba7c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:00.144968 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf511ed5-1caa-4c9f-89a3-6a4773cba7c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:00.145417 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf511ed5-1caa-4c9f-89a3-6a4773cba7c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:00.146941 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf511ed5-1caa-4c9f-89a3-6a4773cba7c6 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:00.156671 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 140/289] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 19:59:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:00.162953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf511ed5-1caa-4c9f-89a3-6a4773cba7c6 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:00.176044 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d2d85-a2a9-49c5-82e4-69494543e1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:00.177032 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d2d85-a2a9-49c5-82e4-69494543e1c7 None admin] REQUEST_METHOD: `PUT` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:00.177419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d2d85-a2a9-49c5-82e4-69494543e1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:00.177818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d2d85-a2a9-49c5-82e4-69494543e1c7 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc/users/d8aa1246302e46efb44e3ffa814539ef/roles/a82cefb7fdd14179a308031eb40d7e48` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:00.180630 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d2d85-a2a9-49c5-82e4-69494543e1c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=68ea978bc82b479ea618aa819bb351fc, user_id=d8aa1246302e46efb44e3ffa814539ef, role_id=a82cefb7fdd14179a308031eb40d7e48)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:00.182067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d2d85-a2a9-49c5-82e4-69494543e1c7 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:00.272001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 150/290] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 20:00:00 2022] PUT /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc/users/d8aa1246302e46efb44e3ffa814539ef/roles/a82cefb7fdd14179a308031eb40d7e48 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 20:00:00.277662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf511ed5-1caa-4c9f-89a3-6a4773cba7c6 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:00.320385 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674ed6-7772-4e2a-8e3a-228e07431a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:00.321670 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674ed6-7772-4e2a-8e3a-228e07431a53 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:00.322193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674ed6-7772-4e2a-8e3a-228e07431a53 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:00.322820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674ed6-7772-4e2a-8e3a-228e07431a53 None admin] PATH_INFO: `/v3/users/70d6459bcbb645d3b7985a3536ad2688` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:00.324422 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa674ed6-7772-4e2a-8e3a-228e07431a53 None admin] RBAC: Authorizing `identity:get_user(user_id=70d6459bcbb645d3b7985a3536ad2688)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:00.326183 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa674ed6-7772-4e2a-8e3a-228e07431a53 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:00.328538 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 141/291] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 20:00:00 2022] GET /identity/v3/users/70d6459bcbb645d3b7985a3536ad2688 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:00.334283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d2d85-a2a9-49c5-82e4-69494543e1c7 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:00.456756 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d2d85-a2a9-49c5-82e4-69494543e1c7 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:00.501609 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc197f-457e-41ab-ac71-28e133cd5aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:00.502306 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc197f-457e-41ab-ac71-28e133cd5aca None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:00.502590 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc197f-457e-41ab-ac71-28e133cd5aca None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:00.502858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc197f-457e-41ab-ac71-28e133cd5aca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:00.573284 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc197f-457e-41ab-ac71-28e133cd5aca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:00.574749 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc197f-457e-41ab-ac71-28e133cd5aca None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:00.673725 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 151/292] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:00.679886 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674ed6-7772-4e2a-8e3a-228e07431a53 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:00.830495 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674ed6-7772-4e2a-8e3a-228e07431a53 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:00.876376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3f87f-4272-43a8-8e6a-04ce59137280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:00.877233 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3f87f-4272-43a8-8e6a-04ce59137280 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:00.877516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3f87f-4272-43a8-8e6a-04ce59137280 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:00.877788 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3f87f-4272-43a8-8e6a-04ce59137280 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:00.884813 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3f87f-4272-43a8-8e6a-04ce59137280 None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:00.886265 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3f87f-4272-43a8-8e6a-04ce59137280 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:00.888003 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 142/293] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:00 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:00.894024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc197f-457e-41ab-ac71-28e133cd5aca None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:01.001617 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc197f-457e-41ab-ac71-28e133cd5aca None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:01.035540 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ab921-fbc0-4295-b8cd-ae0f3d73290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:01.036223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab921-fbc0-4295-b8cd-ae0f3d73290e None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:01.036502 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab921-fbc0-4295-b8cd-ae0f3d73290e None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:01.036773 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab921-fbc0-4295-b8cd-ae0f3d73290e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:01.037594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ab921-fbc0-4295-b8cd-ae0f3d73290e None admin] RBAC: Adding query filter params (role.id=a2a640f930c44b2fa40f432179d7faa4, scope.project.id=68ea978bc82b479ea618aa819bb351fc, user.id=70d6459bcbb645d3b7985a3536ad2688) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:01.037898 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ab921-fbc0-4295-b8cd-ae0f3d73290e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:01.040793 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ab921-fbc0-4295-b8cd-ae0f3d73290e None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:01.047469 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 152/294] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:00:00 2022] GET /identity/v3/role_assignments?user.id=70d6459bcbb645d3b7985a3536ad2688&scope.project.id=68ea978bc82b479ea618aa819bb351fc&role.id=a2a640f930c44b2fa40f432179d7faa4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:01.852345 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed43c6a-a604-4b8e-9d5a-688955b70c61 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:01.852848 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed43c6a-a604-4b8e-9d5a-688955b70c61 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:01.852921 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed43c6a-a604-4b8e-9d5a-688955b70c61 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:01.854810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 143/295] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:01.860103 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dd5b4-fadd-49e2-95e6-fbddfd317b9b None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:01.860517 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dd5b4-fadd-49e2-95e6-fbddfd317b9b None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:01.860653 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dd5b4-fadd-49e2-95e6-fbddfd317b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:01.877690 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-2c6dd5b4-fadd-49e2-95e6-fbddfd317b9b None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:01.878876 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-2c6dd5b4-fadd-49e2-95e6-fbddfd317b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:01.946884 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 153/296] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:01.973035 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed43c6a-a604-4b8e-9d5a-688955b70c61 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:02.107479 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed43c6a-a604-4b8e-9d5a-688955b70c61 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:02.141661 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542435a-bcdd-4b28-8205-1349047b6f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:02.142461 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542435a-bcdd-4b28-8205-1349047b6f8a None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:02.142742 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542435a-bcdd-4b28-8205-1349047b6f8a None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:02.143013 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542435a-bcdd-4b28-8205-1349047b6f8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:02.153835 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542435a-bcdd-4b28-8205-1349047b6f8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-2542435a-bcdd-4b28-8205-1349047b6f8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:02.161812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:02.162691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:02.164462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:02.164462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:02.164462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:02.164462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:02.164462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:02.164462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:02.164462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:02.164462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:02.164462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:02.164462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:02.164462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:02.164462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:02.164462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 144/297] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:02.170295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dd5b4-fadd-49e2-95e6-fbddfd317b9b None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:02.271677 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dd5b4-fadd-49e2-95e6-fbddfd317b9b None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:02.306742 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce01e92-43b9-4792-b068-c8fefea9a330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:02.307418 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce01e92-43b9-4792-b068-c8fefea9a330 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:02.307685 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce01e92-43b9-4792-b068-c8fefea9a330 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:02.307961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce01e92-43b9-4792-b068-c8fefea9a330 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:02.308733 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce01e92-43b9-4792-b068-c8fefea9a330 None admin] RBAC: Adding query filter params (name=member) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:02.309038 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce01e92-43b9-4792-b068-c8fefea9a330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:02.310426 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce01e92-43b9-4792-b068-c8fefea9a330 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:02.318991 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 154/298] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 20:00:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:02.324764 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542435a-bcdd-4b28-8205-1349047b6f8a None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:02.426861 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542435a-bcdd-4b28-8205-1349047b6f8a None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:02.461903 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8af120-c9d6-4da6-b054-29e8f5db4406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:02.462783 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8af120-c9d6-4da6-b054-29e8f5db4406 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:02.463057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8af120-c9d6-4da6-b054-29e8f5db4406 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:02.463325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8af120-c9d6-4da6-b054-29e8f5db4406 None admin] PATH_INFO: `/v3/users/fe2cf48c3a67413484816383bcdd708b` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:02.464587 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8af120-c9d6-4da6-b054-29e8f5db4406 None admin] RBAC: Authorizing `identity:get_user(user_id=fe2cf48c3a67413484816383bcdd708b)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:02.466050 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8af120-c9d6-4da6-b054-29e8f5db4406 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:02.468052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 145/299] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 20:00:02 2022] GET /identity/v3/users/fe2cf48c3a67413484816383bcdd708b => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:02.473891 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce01e92-43b9-4792-b068-c8fefea9a330 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:02.584733 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce01e92-43b9-4792-b068-c8fefea9a330 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:02.620236 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ca84c-b3b0-41b1-8b25-665bb4dad3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:02.621105 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ca84c-b3b0-41b1-8b25-665bb4dad3d4 None admin] REQUEST_METHOD: `PUT` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:02.621386 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ca84c-b3b0-41b1-8b25-665bb4dad3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:02.621664 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ca84c-b3b0-41b1-8b25-665bb4dad3d4 None admin] PATH_INFO: `/v3/system/users/fe2cf48c3a67413484816383bcdd708b/roles/a2a640f930c44b2fa40f432179d7faa4` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:02.623303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ca84c-b3b0-41b1-8b25-665bb4dad3d4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fe2cf48c3a67413484816383bcdd708b, role_id=a2a640f930c44b2fa40f432179d7faa4)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:02.624734 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ca84c-b3b0-41b1-8b25-665bb4dad3d4 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:02.719197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 155/300] 10.222.0.58 () {58 vars in 1334 bytes} [Fri Apr 29 20:00:02 2022] PUT /identity/v3/system/users/fe2cf48c3a67413484816383bcdd708b/roles/a2a640f930c44b2fa40f432179d7faa4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:00:02.747291 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3be21-1a7a-4783-9f09-747fa5e09ef1 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:02.747602 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3be21-1a7a-4783-9f09-747fa5e09ef1 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:02.747845 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3be21-1a7a-4783-9f09-747fa5e09ef1 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:02.749543 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 146/301] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:02.755576 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6824f1c-766d-4bf0-b694-c31637f2ca8c None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:02.755909 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6824f1c-766d-4bf0-b694-c31637f2ca8c None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:02.756224 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6824f1c-766d-4bf0-b694-c31637f2ca8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:02.776814 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-a6824f1c-766d-4bf0-b694-c31637f2ca8c None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:02.778146 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-a6824f1c-766d-4bf0-b694-c31637f2ca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:02.829507 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34448b8-e67f-490b-a753-f811acbc0a9f None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:02.829841 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34448b8-e67f-490b-a753-f811acbc0a9f None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:02.830065 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34448b8-e67f-490b-a753-f811acbc0a9f None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:02.831777 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 147/302] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:00:02.838333 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbddcda-7ba0-4475-a1ba-87e5afca5d68 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:02.838644 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbddcda-7ba0-4475-a1ba-87e5afca5d68 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:02.838881 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbddcda-7ba0-4475-a1ba-87e5afca5d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:02.858074 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-dfbddcda-7ba0-4475-a1ba-87e5afca5d68 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:02.859752 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-dfbddcda-7ba0-4475-a1ba-87e5afca5d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:02.867589 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 156/303] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:02.893622 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6824f1c-766d-4bf0-b694-c31637f2ca8c None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:02.933842 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 148/304] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 20:00:02.958410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbddcda-7ba0-4475-a1ba-87e5afca5d68 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:02.996610 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6824f1c-766d-4bf0-b694-c31637f2ca8c None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:03.031707 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacdddd-a868-4592-aa9e-c2a88be54e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:03.032597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacdddd-a868-4592-aa9e-c2a88be54e10 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:03.032883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacdddd-a868-4592-aa9e-c2a88be54e10 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:03.033158 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacdddd-a868-4592-aa9e-c2a88be54e10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:03.034335 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacdddd-a868-4592-aa9e-c2a88be54e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:03.035797 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacdddd-a868-4592-aa9e-c2a88be54e10 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:03.037831 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 157/305] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:03.043428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacdddd-a868-4592-aa9e-c2a88be54e10 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:03.065409 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbddcda-7ba0-4475-a1ba-87e5afca5d68 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:03.100793 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46a3fc-7493-476a-9469-fb49551a83b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:03.101617 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46a3fc-7493-476a-9469-fb49551a83b4 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:03.101900 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46a3fc-7493-476a-9469-fb49551a83b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:03.102176 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46a3fc-7493-476a-9469-fb49551a83b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:03.115079 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46a3fc-7493-476a-9469-fb49551a83b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-af46a3fc-7493-476a-9469-fb49551a83b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:03.125722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:03.126697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:03.133255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:03.133255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:03.133255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:03.133255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:03.133255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:03.133255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:03.133255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:03.133255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:03.133255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:03.133255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:03.133255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 20:00:03.133255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:03.133255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 149/306] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:03.133255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb722d-402e-43d2-9cf2-d367863d87fe None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:03.134023 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb722d-402e-43d2-9cf2-d367863d87fe None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:03.134023 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb722d-402e-43d2-9cf2-d367863d87fe None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:03.134023 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 150/307] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:03.134023 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb722d-402e-43d2-9cf2-d367863d87fe None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:03.155821 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacdddd-a868-4592-aa9e-c2a88be54e10 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:03.195933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a15c1-034a-43a0-9486-a4e50c180be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:03.197061 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a15c1-034a-43a0-9486-a4e50c180be0 None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:03.197380 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a15c1-034a-43a0-9486-a4e50c180be0 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:03.197806 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a15c1-034a-43a0-9486-a4e50c180be0 None admin] PATH_INFO: `/v3/groups` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:03.198541 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a15c1-034a-43a0-9486-a4e50c180be0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:03.199968 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a15c1-034a-43a0-9486-a4e50c180be0 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:03.235462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb722d-402e-43d2-9cf2-d367863d87fe None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:03.260096 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 158/308] 10.222.0.58 () {60 vars in 1134 bytes} [Fri Apr 29 20:00:03 2022] POST /identity/v3/groups => generated 229 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:00:03.267772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82480f-495a-4b94-9f7b-643cb658bc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:03.268520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82480f-495a-4b94-9f7b-643cb658bc69 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:03.268798 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82480f-495a-4b94-9f7b-643cb658bc69 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:03.269068 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82480f-495a-4b94-9f7b-643cb658bc69 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:03.269645 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b19b2-4029-4fc3-8b19-4558fdb03012 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:03.269823 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82480f-495a-4b94-9f7b-643cb658bc69 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:03.269930 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b19b2-4029-4fc3-8b19-4558fdb03012 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:03.270108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82480f-495a-4b94-9f7b-643cb658bc69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:03.270215 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b19b2-4029-4fc3-8b19-4558fdb03012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:03.271527 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82480f-495a-4b94-9f7b-643cb658bc69 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:03.292087 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 151/309] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 20:00:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:03.294604 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82480f-495a-4b94-9f7b-643cb658bc69 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:03.295185 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-166b19b2-4029-4fc3-8b19-4558fdb03012 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:03.296673 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-166b19b2-4029-4fc3-8b19-4558fdb03012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:03.382041 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 159/310] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:03.414830 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b19b2-4029-4fc3-8b19-4558fdb03012 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:03.417634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82480f-495a-4b94-9f7b-643cb658bc69 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:03.453943 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e093990-1461-4c77-bb2f-46069c4a613a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:03.454603 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093990-1461-4c77-bb2f-46069c4a613a None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:03.454888 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093990-1461-4c77-bb2f-46069c4a613a None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:03.455165 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093990-1461-4c77-bb2f-46069c4a613a None admin] PATH_INFO: `/v3/users/1da50537c4ca4fba99c0ee244a1a8744` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:03.473754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e093990-1461-4c77-bb2f-46069c4a613a None admin] RBAC: Authorizing `identity:get_user(user_id=1da50537c4ca4fba99c0ee244a1a8744)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:03.475563 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e093990-1461-4c77-bb2f-46069c4a613a None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:03.478702 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 152/311] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 20:00:03 2022] GET /identity/v3/users/1da50537c4ca4fba99c0ee244a1a8744 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:03.484551 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e093990-1461-4c77-bb2f-46069c4a613a None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:03.536371 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b19b2-4029-4fc3-8b19-4558fdb03012 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:03.572164 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3747cdc-5ba5-4599-8770-f0f98d378253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:03.573315 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3747cdc-5ba5-4599-8770-f0f98d378253 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:03.573809 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3747cdc-5ba5-4599-8770-f0f98d378253 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:03.574321 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3747cdc-5ba5-4599-8770-f0f98d378253 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:03.584855 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3747cdc-5ba5-4599-8770-f0f98d378253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-c3747cdc-5ba5-4599-8770-f0f98d378253 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:03.593594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:03.594506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:03.595295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:03.595295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:03.595295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:03.595295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:03.595295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:03.595295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:03.595295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:03.595295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:03.595295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:03.595295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:03.595295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 20:00:03.595295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:03.597627 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 160/312] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:03.598409 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e093990-1461-4c77-bb2f-46069c4a613a None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:03.603962 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3747cdc-5ba5-4599-8770-f0f98d378253 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:03.639337 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84c6c2-bcd9-4158-a1f4-a014271aa88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:03.640098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84c6c2-bcd9-4158-a1f4-a014271aa88b None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:03.640590 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84c6c2-bcd9-4158-a1f4-a014271aa88b None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:03.640879 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84c6c2-bcd9-4158-a1f4-a014271aa88b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:03.642058 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84c6c2-bcd9-4158-a1f4-a014271aa88b None admin] RBAC: Adding query filter params (role.id=a82cefb7fdd14179a308031eb40d7e48, user.id=1da50537c4ca4fba99c0ee244a1a8744, scope.system=all) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:03.642379 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84c6c2-bcd9-4158-a1f4-a014271aa88b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:03.644136 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84c6c2-bcd9-4158-a1f4-a014271aa88b None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:03.651392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 153/313] 10.222.0.58 () {56 vars in 1308 bytes} [Fri Apr 29 20:00:03 2022] GET /identity/v3/role_assignments?user.id=1da50537c4ca4fba99c0ee244a1a8744&scope.system=all&role.id=a82cefb7fdd14179a308031eb40d7e48 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:03.724094 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3747cdc-5ba5-4599-8770-f0f98d378253 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:03.762109 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c720c1-49d7-427f-887b-dca2bc9bbb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:03.763093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c720c1-49d7-427f-887b-dca2bc9bbb37 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:03.763545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c720c1-49d7-427f-887b-dca2bc9bbb37 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:03.764008 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c720c1-49d7-427f-887b-dca2bc9bbb37 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:03.764931 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c720c1-49d7-427f-887b-dca2bc9bbb37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:03.765430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c720c1-49d7-427f-887b-dca2bc9bbb37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:03.767024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c720c1-49d7-427f-887b-dca2bc9bbb37 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:03.777414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 161/314] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 20:00:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:03.784026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84c6c2-bcd9-4158-a1f4-a014271aa88b None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:03.886052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84c6c2-bcd9-4158-a1f4-a014271aa88b None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:03.919886 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb9997-649d-4fab-9216-d04574d12409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:03.920772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb9997-649d-4fab-9216-d04574d12409 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:03.921053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb9997-649d-4fab-9216-d04574d12409 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:03.921324 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb9997-649d-4fab-9216-d04574d12409 None admin] PATH_INFO: `/v3/users/d8aa1246302e46efb44e3ffa814539ef` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:03.922507 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb9997-649d-4fab-9216-d04574d12409 None admin] RBAC: Authorizing `identity:get_user(user_id=d8aa1246302e46efb44e3ffa814539ef)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:03.923954 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb9997-649d-4fab-9216-d04574d12409 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:03.925905 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 154/315] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 20:00:03 2022] GET /identity/v3/users/d8aa1246302e46efb44e3ffa814539ef => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:03.931359 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c720c1-49d7-427f-887b-dca2bc9bbb37 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:04.033477 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c720c1-49d7-427f-887b-dca2bc9bbb37 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:04.066953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a388-934c-4689-91eb-2dad6d017e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:04.067594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a388-934c-4689-91eb-2dad6d017e34 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:04.067867 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a388-934c-4689-91eb-2dad6d017e34 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:04.068167 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a388-934c-4689-91eb-2dad6d017e34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:04.135161 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852a388-934c-4689-91eb-2dad6d017e34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:04.136709 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852a388-934c-4689-91eb-2dad6d017e34 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:04.237042 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 162/316] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:04.243020 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb9997-649d-4fab-9216-d04574d12409 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:04.341770 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb9997-649d-4fab-9216-d04574d12409 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:04.376037 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e4848-37c9-4a65-a9b5-b3467740e876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:04.376896 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e4848-37c9-4a65-a9b5-b3467740e876 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:04.377175 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e4848-37c9-4a65-a9b5-b3467740e876 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:04.377445 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e4848-37c9-4a65-a9b5-b3467740e876 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:04.378616 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e4848-37c9-4a65-a9b5-b3467740e876 None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:04.380186 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e4848-37c9-4a65-a9b5-b3467740e876 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:04.382065 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 155/317] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:04 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:04.387806 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a388-934c-4689-91eb-2dad6d017e34 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:04.486782 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a388-934c-4689-91eb-2dad6d017e34 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:04.519803 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4d620-bd5c-4553-a4fb-fd337d37dc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:04.520501 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4d620-bd5c-4553-a4fb-fd337d37dc62 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:04.520777 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4d620-bd5c-4553-a4fb-fd337d37dc62 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:04.521047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4d620-bd5c-4553-a4fb-fd337d37dc62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:04.522017 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4d620-bd5c-4553-a4fb-fd337d37dc62 None admin] RBAC: Adding query filter params (role.id=a82cefb7fdd14179a308031eb40d7e48, scope.project.id=68ea978bc82b479ea618aa819bb351fc, user.id=d8aa1246302e46efb44e3ffa814539ef) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:04.522328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4d620-bd5c-4553-a4fb-fd337d37dc62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:04.524414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4d620-bd5c-4553-a4fb-fd337d37dc62 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:04.530527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 163/318] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:00:04 2022] GET /identity/v3/role_assignments?user.id=d8aa1246302e46efb44e3ffa814539ef&scope.project.id=68ea978bc82b479ea618aa819bb351fc&role.id=a82cefb7fdd14179a308031eb40d7e48 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:05.162523 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3b92-df12-4a4a-8665-52be707e32e3 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:05.163040 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3b92-df12-4a4a-8665-52be707e32e3 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:05.163116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3b92-df12-4a4a-8665-52be707e32e3 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:05.165157 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 156/319] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:05.170290 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f196f7b-127a-40e1-bfd5-89ecf5aa7af4 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:05.170679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f196f7b-127a-40e1-bfd5-89ecf5aa7af4 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:05.170841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f196f7b-127a-40e1-bfd5-89ecf5aa7af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:05.187067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-5f196f7b-127a-40e1-bfd5-89ecf5aa7af4 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:05.188284 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-5f196f7b-127a-40e1-bfd5-89ecf5aa7af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:05.252674 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 164/320] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:05.278082 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a3b92-df12-4a4a-8665-52be707e32e3 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:05.384059 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a3b92-df12-4a4a-8665-52be707e32e3 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:05.417914 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d348e-41fa-47df-9d8e-3d0332c9f0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:05.418627 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d348e-41fa-47df-9d8e-3d0332c9f0d5 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:05.418909 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d348e-41fa-47df-9d8e-3d0332c9f0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:05.419180 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d348e-41fa-47df-9d8e-3d0332c9f0d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:05.428955 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d348e-41fa-47df-9d8e-3d0332c9f0d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-336d348e-41fa-47df-9d8e-3d0332c9f0d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:05.437257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:05.438151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:05.438995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:05.438995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:05.438995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:05.438995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:05.438995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:05.438995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:05.438995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:05.438995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:05.438995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:05.438995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:05.438995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:05.438995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:05.446241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 157/321] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:05.446371 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f196f7b-127a-40e1-bfd5-89ecf5aa7af4 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:05.542841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f196f7b-127a-40e1-bfd5-89ecf5aa7af4 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:05.575177 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72275dbd-f361-4c2b-997b-4d6ee0e45c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:05.575842 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72275dbd-f361-4c2b-997b-4d6ee0e45c24 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:05.576161 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72275dbd-f361-4c2b-997b-4d6ee0e45c24 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:05.576434 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72275dbd-f361-4c2b-997b-4d6ee0e45c24 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:05.577168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72275dbd-f361-4c2b-997b-4d6ee0e45c24 None admin] RBAC: Adding query filter params (name=member) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:05.577475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72275dbd-f361-4c2b-997b-4d6ee0e45c24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:05.578852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72275dbd-f361-4c2b-997b-4d6ee0e45c24 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:05.586946 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 165/322] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 20:00:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:05.592261 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d348e-41fa-47df-9d8e-3d0332c9f0d5 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:05.691240 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d348e-41fa-47df-9d8e-3d0332c9f0d5 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:05.691493 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035e5f6-bf96-4d8f-bf16-b655e1e9f4cc None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:05.691734 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035e5f6-bf96-4d8f-bf16-b655e1e9f4cc None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:05.691929 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035e5f6-bf96-4d8f-bf16-b655e1e9f4cc None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:05.693323 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 166/323] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:00:05.698172 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a90dcc-93f5-4f9d-8cee-683d5891dd5a None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:05.698458 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a90dcc-93f5-4f9d-8cee-683d5891dd5a None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:05.698728 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a90dcc-93f5-4f9d-8cee-683d5891dd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:05.715095 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-59a90dcc-93f5-4f9d-8cee-683d5891dd5a None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:05.716281 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-59a90dcc-93f5-4f9d-8cee-683d5891dd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:05.724784 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc750af-f69e-4d5f-95bc-42a872e84419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:05.725660 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc750af-f69e-4d5f-95bc-42a872e84419 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:05.726000 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc750af-f69e-4d5f-95bc-42a872e84419 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:05.726789 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc750af-f69e-4d5f-95bc-42a872e84419 None admin] PATH_INFO: `/v3/users/fe2cf48c3a67413484816383bcdd708b` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:05.728012 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc750af-f69e-4d5f-95bc-42a872e84419 None admin] RBAC: Authorizing `identity:get_user(user_id=fe2cf48c3a67413484816383bcdd708b)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:05.729725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc750af-f69e-4d5f-95bc-42a872e84419 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:05.731513 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 158/324] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 20:00:05 2022] GET /identity/v3/users/fe2cf48c3a67413484816383bcdd708b => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:05.736830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc750af-f69e-4d5f-95bc-42a872e84419 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:05.788310 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 167/325] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 20:00:05.807640 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a90dcc-93f5-4f9d-8cee-683d5891dd5a None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:05.835892 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc750af-f69e-4d5f-95bc-42a872e84419 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:05.874939 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6c3cd-e222-4ede-8760-4e8643bdaf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:05.875588 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6c3cd-e222-4ede-8760-4e8643bdaf14 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:05.875869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6c3cd-e222-4ede-8760-4e8643bdaf14 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:05.876178 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6c3cd-e222-4ede-8760-4e8643bdaf14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:05.876998 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6c3cd-e222-4ede-8760-4e8643bdaf14 None admin] RBAC: Adding query filter params (role.id=a2a640f930c44b2fa40f432179d7faa4, user.id=fe2cf48c3a67413484816383bcdd708b, scope.system=all) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:05.877307 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6c3cd-e222-4ede-8760-4e8643bdaf14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:05.878743 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6c3cd-e222-4ede-8760-4e8643bdaf14 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:05.890261 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 159/326] 10.222.0.58 () {56 vars in 1308 bytes} [Fri Apr 29 20:00:05 2022] GET /identity/v3/role_assignments?user.id=fe2cf48c3a67413484816383bcdd708b&scope.system=all&role.id=a2a640f930c44b2fa40f432179d7faa4 => generated 510 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:05.908283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a90dcc-93f5-4f9d-8cee-683d5891dd5a None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:05.944688 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d0e87-d2b5-4fef-9b57-5e237ca1b532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:05.946396 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d0e87-d2b5-4fef-9b57-5e237ca1b532 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:05.946845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d0e87-d2b5-4fef-9b57-5e237ca1b532 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:05.947274 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d0e87-d2b5-4fef-9b57-5e237ca1b532 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:05.948803 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d0e87-d2b5-4fef-9b57-5e237ca1b532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:05.950577 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d0e87-d2b5-4fef-9b57-5e237ca1b532 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:05.952868 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 168/327] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:05.958726 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6c3cd-e222-4ede-8760-4e8643bdaf14 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:06.022307 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5937ee4-5489-4c74-a0bc-06c134501701 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:06.022660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5937ee4-5489-4c74-a0bc-06c134501701 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:06.022882 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5937ee4-5489-4c74-a0bc-06c134501701 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:06.024848 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 169/328] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:00:06.030790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf88641-17fc-48ae-88e2-ef96dd3af4ce None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:06.031497 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf88641-17fc-48ae-88e2-ef96dd3af4ce None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:06.031497 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf88641-17fc-48ae-88e2-ef96dd3af4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:06.048229 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-dcf88641-17fc-48ae-88e2-ef96dd3af4ce None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:06.049715 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-dcf88641-17fc-48ae-88e2-ef96dd3af4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:06.067315 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6c3cd-e222-4ede-8760-4e8643bdaf14 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:06.106908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e54fa-7ca3-4a8b-9008-a799dafa1a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:06.107574 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e54fa-7ca3-4a8b-9008-a799dafa1a9e None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:06.107869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e54fa-7ca3-4a8b-9008-a799dafa1a9e None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:06.108164 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e54fa-7ca3-4a8b-9008-a799dafa1a9e None admin] PATH_INFO: `/v3/groups` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:06.108852 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e54fa-7ca3-4a8b-9008-a799dafa1a9e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:06.110306 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e54fa-7ca3-4a8b-9008-a799dafa1a9e None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:06.129781 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 170/329] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 20:00:06.154638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf88641-17fc-48ae-88e2-ef96dd3af4ce None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:06.201316 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 160/330] 10.222.0.58 () {60 vars in 1134 bytes} [Fri Apr 29 20:00:05 2022] POST /identity/v3/groups => generated 226 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:00:06.253297 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf88641-17fc-48ae-88e2-ef96dd3af4ce None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:06.289928 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b740b-20d3-4208-bcf4-c1a374110ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:06.290738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b740b-20d3-4208-bcf4-c1a374110ff7 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:06.291019 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b740b-20d3-4208-bcf4-c1a374110ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:06.291292 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b740b-20d3-4208-bcf4-c1a374110ff7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:06.302235 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b740b-20d3-4208-bcf4-c1a374110ff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-b50b740b-20d3-4208-bcf4-c1a374110ff7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:06.310301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:06.311402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:06.312264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:06.312264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:06.312264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:06.312264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:06.312264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:06.312264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:06.312264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:06.312264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:06.312264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:06.312264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:06.312264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 20:00:06.312264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:06.312264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 171/331] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:06.317590 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e54fa-7ca3-4a8b-9008-a799dafa1a9e None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:06.420409 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e54fa-7ca3-4a8b-9008-a799dafa1a9e None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:06.452603 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ad05b-69fe-4520-bbb0-8b2ba0c94e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:06.453201 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ad05b-69fe-4520-bbb0-8b2ba0c94e5f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:06.453479 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ad05b-69fe-4520-bbb0-8b2ba0c94e5f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:06.453750 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ad05b-69fe-4520-bbb0-8b2ba0c94e5f None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:06.454483 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ad05b-69fe-4520-bbb0-8b2ba0c94e5f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:06.454782 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ad05b-69fe-4520-bbb0-8b2ba0c94e5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:06.456189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ad05b-69fe-4520-bbb0-8b2ba0c94e5f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:06.465172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 161/332] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 20:00:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:06.470812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b740b-20d3-4208-bcf4-c1a374110ff7 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:06.573532 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b740b-20d3-4208-bcf4-c1a374110ff7 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:06.609613 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982f375-e841-4b45-aa81-4556d9bfaf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:06.610502 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982f375-e841-4b45-aa81-4556d9bfaf53 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:06.610780 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982f375-e841-4b45-aa81-4556d9bfaf53 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:06.611053 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982f375-e841-4b45-aa81-4556d9bfaf53 None admin] PATH_INFO: `/v3/users/1da50537c4ca4fba99c0ee244a1a8744` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:06.612360 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982f375-e841-4b45-aa81-4556d9bfaf53 None admin] RBAC: Authorizing `identity:get_user(user_id=1da50537c4ca4fba99c0ee244a1a8744)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:06.613808 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982f375-e841-4b45-aa81-4556d9bfaf53 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:06.615804 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 172/333] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 20:00:06 2022] GET /identity/v3/users/1da50537c4ca4fba99c0ee244a1a8744 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:06.621522 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ad05b-69fe-4520-bbb0-8b2ba0c94e5f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:06.728201 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ad05b-69fe-4520-bbb0-8b2ba0c94e5f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:06.762643 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c61f5-e612-4168-af75-8c0bd4e0012f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:06.763513 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c61f5-e612-4168-af75-8c0bd4e0012f None admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:06.763788 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c61f5-e612-4168-af75-8c0bd4e0012f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:06.764099 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c61f5-e612-4168-af75-8c0bd4e0012f None admin] PATH_INFO: `/v3/system/users/1da50537c4ca4fba99c0ee244a1a8744/roles/a82cefb7fdd14179a308031eb40d7e48` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:06.765607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c61f5-e612-4168-af75-8c0bd4e0012f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1da50537c4ca4fba99c0ee244a1a8744, role_id=a82cefb7fdd14179a308031eb40d7e48)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:06.767005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c61f5-e612-4168-af75-8c0bd4e0012f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:06.861335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 162/334] 10.222.0.58 () {58 vars in 1334 bytes} [Fri Apr 29 20:00:06 2022] PUT /identity/v3/system/users/1da50537c4ca4fba99c0ee244a1a8744/roles/a82cefb7fdd14179a308031eb40d7e48 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:00:09.487234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a6007-5d72-4485-9238-8358227def5d None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:09.487738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a6007-5d72-4485-9238-8358227def5d None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:09.487838 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a6007-5d72-4485-9238-8358227def5d None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:09.489154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 173/335] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:09.494687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ddddc-7ead-432a-aa20-cacaf49c2dd1 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:09.495121 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ddddc-7ead-432a-aa20-cacaf49c2dd1 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:09.495242 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ddddc-7ead-432a-aa20-cacaf49c2dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:09.520996 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-735ddddc-7ead-432a-aa20-cacaf49c2dd1 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:09.522445 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-735ddddc-7ead-432a-aa20-cacaf49c2dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:09.604436 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 163/336] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 20:00:09.634346 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943140b-e53d-4656-a764-f7b8a2c4eb02 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:09.634978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943140b-e53d-4656-a764-f7b8a2c4eb02 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:09.635482 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943140b-e53d-4656-a764-f7b8a2c4eb02 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:09.637474 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 174/337] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:09.640934 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ddddc-7ead-432a-aa20-cacaf49c2dd1 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:09.646338 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64990094-7ba6-4234-9673-e1f4156b7eb5 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:09.646927 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64990094-7ba6-4234-9673-e1f4156b7eb5 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:09.647414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64990094-7ba6-4234-9673-e1f4156b7eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:09.680344 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-64990094-7ba6-4234-9673-e1f4156b7eb5 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:09.682103 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-64990094-7ba6-4234-9673-e1f4156b7eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:09.816731 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ddddc-7ead-432a-aa20-cacaf49c2dd1 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:09.826666 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 175/338] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:09.847966 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab097f-a79b-40f2-98c5-c52282445f68 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:09.848288 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab097f-a79b-40f2-98c5-c52282445f68 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:09.848552 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab097f-a79b-40f2-98c5-c52282445f68 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:09.850241 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 176/339] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:00:09.857862 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb11dae-a37b-41f0-9d71-c0115061fa3f None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:09.858123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb11dae-a37b-41f0-9d71-c0115061fa3f None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:09.858338 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb11dae-a37b-41f0-9d71-c0115061fa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:09.871625 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d0a41-dc58-484e-8a32-bd55cb3338a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:09.881756 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d0a41-dc58-484e-8a32-bd55cb3338a0 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:09.881756 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d0a41-dc58-484e-8a32-bd55cb3338a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:09.881756 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d0a41-dc58-484e-8a32-bd55cb3338a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:09.886877 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-3bb11dae-a37b-41f0-9d71-c0115061fa3f None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:09.888090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-3bb11dae-a37b-41f0-9d71-c0115061fa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:09.888695 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d0a41-dc58-484e-8a32-bd55cb3338a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-f44d0a41-dc58-484e-8a32-bd55cb3338a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:09.900372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:09.901300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:09.902487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:09.902487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:09.902487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:09.902487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:09.902487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:09.902487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:09.902487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:09.902487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:09.902487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:09.902487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:09.902487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 20:00:09.902487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:09.902487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 164/340] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 20:00:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:09.903159 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cffcfe-15f7-414a-a286-1a359c6d86ef None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:09.903159 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cffcfe-15f7-414a-a286-1a359c6d86ef None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:09.903548 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cffcfe-15f7-414a-a286-1a359c6d86ef None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:09.907001 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 165/341] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:09.908354 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cffcfe-15f7-414a-a286-1a359c6d86ef None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:09.989557 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 177/342] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:09.990542 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb11dae-a37b-41f0-9d71-c0115061fa3f None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:10.045895 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cffcfe-15f7-414a-a286-1a359c6d86ef None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:10.090726 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4290b5-36ab-4608-a431-a1b495cfea81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:10.091519 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4290b5-36ab-4608-a431-a1b495cfea81 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:10.091808 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4290b5-36ab-4608-a431-a1b495cfea81 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:10.092116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4290b5-36ab-4608-a431-a1b495cfea81 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:10.093406 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4290b5-36ab-4608-a431-a1b495cfea81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:10.093733 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4290b5-36ab-4608-a431-a1b495cfea81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:10.095426 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4290b5-36ab-4608-a431-a1b495cfea81 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:10.108436 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 166/343] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:10.115714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3c338-7766-4921-a19a-1f5c964885d8 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:10.116028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3c338-7766-4921-a19a-1f5c964885d8 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:10.116312 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3c338-7766-4921-a19a-1f5c964885d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:10.120768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb11dae-a37b-41f0-9d71-c0115061fa3f None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:10.135531 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-68f3c338-7766-4921-a19a-1f5c964885d8 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:10.136738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-68f3c338-7766-4921-a19a-1f5c964885d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:10.157854 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea00c4e-d287-4ba9-9460-d126a1ccfe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:10.158659 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea00c4e-d287-4ba9-9460-d126a1ccfe29 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:10.158939 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea00c4e-d287-4ba9-9460-d126a1ccfe29 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:10.159208 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea00c4e-d287-4ba9-9460-d126a1ccfe29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:10.172860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea00c4e-d287-4ba9-9460-d126a1ccfe29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-1ea00c4e-d287-4ba9-9460-d126a1ccfe29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:10.180922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:10.181859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:10.183574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:10.183574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:10.183574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:10.183574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:10.183574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:10.183574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:10.183574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:10.183574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:10.183574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:10.183574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:10.183574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:10.183574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:10.183574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 178/344] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:10.183574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea00c4e-d287-4ba9-9460-d126a1ccfe29 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:10.229341 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 167/345] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:10.234536 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3c338-7766-4921-a19a-1f5c964885d8 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:10.290929 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea00c4e-d287-4ba9-9460-d126a1ccfe29 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:10.325706 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8347fc-3e9a-49ec-b683-56ae3bbf31c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:10.326511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8347fc-3e9a-49ec-b683-56ae3bbf31c2 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:10.326792 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8347fc-3e9a-49ec-b683-56ae3bbf31c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:10.327063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8347fc-3e9a-49ec-b683-56ae3bbf31c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:10.338446 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8347fc-3e9a-49ec-b683-56ae3bbf31c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-db8347fc-3e9a-49ec-b683-56ae3bbf31c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:10.359736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:10.362090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:10.364153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:10.364153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:10.364153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:10.364153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:10.364153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:10.364153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:10.364153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:10.364153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:10.364153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:10.364153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:10.364153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:10.364153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:10.364153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 179/346] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:10.364153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8347fc-3e9a-49ec-b683-56ae3bbf31c2 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:10.372007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3c338-7766-4921-a19a-1f5c964885d8 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:10.404880 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e212f-1c85-42fb-b682-c90d59b776df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:10.405529 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e212f-1c85-42fb-b682-c90d59b776df None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:10.405810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e212f-1c85-42fb-b682-c90d59b776df None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:10.406085 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e212f-1c85-42fb-b682-c90d59b776df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:10.482404 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e212f-1c85-42fb-b682-c90d59b776df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:10.483853 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e212f-1c85-42fb-b682-c90d59b776df None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:10.484172 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8347fc-3e9a-49ec-b683-56ae3bbf31c2 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:10.526306 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a88db-92c9-4414-9cc7-d72b29267ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:10.527684 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a88db-92c9-4414-9cc7-d72b29267ace None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:10.528147 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a88db-92c9-4414-9cc7-d72b29267ace None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:10.528570 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a88db-92c9-4414-9cc7-d72b29267ace None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:10.529449 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a88db-92c9-4414-9cc7-d72b29267ace None admin] RBAC: Adding query filter params (name=member) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:10.529895 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a88db-92c9-4414-9cc7-d72b29267ace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:10.531440 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a88db-92c9-4414-9cc7-d72b29267ace None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:10.541245 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 180/347] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 20:00:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:10.542280 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a88db-92c9-4414-9cc7-d72b29267ace None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:10.596304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 168/348] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:10.597728 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e212f-1c85-42fb-b682-c90d59b776df None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:10.645616 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a88db-92c9-4414-9cc7-d72b29267ace None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:10.681235 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b6773-0b5f-4b9b-a08e-c4d8b7f44724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:10.682055 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b6773-0b5f-4b9b-a08e-c4d8b7f44724 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:10.682331 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b6773-0b5f-4b9b-a08e-c4d8b7f44724 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:10.682599 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b6773-0b5f-4b9b-a08e-c4d8b7f44724 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:10.694766 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b6773-0b5f-4b9b-a08e-c4d8b7f44724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-400b6773-0b5f-4b9b-a08e-c4d8b7f44724 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:10.703451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:10.704545 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:10.705510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:10.705510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:10.705510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:10.705510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:10.705510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:10.705510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:10.705510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:10.705510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:10.705510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:10.705510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:10.705510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 20:00:10.705510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:10.707873 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 181/349] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 20:00:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:10.709288 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9f35c-6899-4a6f-82ee-d18a3540d139 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:10.709719 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9f35c-6899-4a6f-82ee-d18a3540d139 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:10.710166 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9f35c-6899-4a6f-82ee-d18a3540d139 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:10.711640 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 182/350] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:10.712517 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9f35c-6899-4a6f-82ee-d18a3540d139 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:10.717264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e212f-1c85-42fb-b682-c90d59b776df None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:10.757729 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a83fd-cc46-4001-afca-7dc286d7fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:10.758427 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a83fd-cc46-4001-afca-7dc286d7fca2 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:10.758752 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a83fd-cc46-4001-afca-7dc286d7fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:10.759023 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a83fd-cc46-4001-afca-7dc286d7fca2 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:10.759725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a83fd-cc46-4001-afca-7dc286d7fca2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:10.760957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a83fd-cc46-4001-afca-7dc286d7fca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:10.761470 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a83fd-cc46-4001-afca-7dc286d7fca2 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:10.771755 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 169/351] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 20:00:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:10.772635 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a83fd-cc46-4001-afca-7dc286d7fca2 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:10.850757 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9f35c-6899-4a6f-82ee-d18a3540d139 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:10.894363 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a83fd-cc46-4001-afca-7dc286d7fca2 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:10.897090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31863d06-cec1-42b1-93d5-147f0680ac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:10.898349 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31863d06-cec1-42b1-93d5-147f0680ac38 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:10.898631 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31863d06-cec1-42b1-93d5-147f0680ac38 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:10.898907 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31863d06-cec1-42b1-93d5-147f0680ac38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:10.933117 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99bfca-c35d-4f93-9ff9-80f893363caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:10.933117 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99bfca-c35d-4f93-9ff9-80f893363caa None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:10.933439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99bfca-c35d-4f93-9ff9-80f893363caa None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:10.933681 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99bfca-c35d-4f93-9ff9-80f893363caa None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:10.935784 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99bfca-c35d-4f93-9ff9-80f893363caa None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:10.937527 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99bfca-c35d-4f93-9ff9-80f893363caa None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:10.941101 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 170/352] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:10 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:10.941902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99bfca-c35d-4f93-9ff9-80f893363caa None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:10.992028 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31863d06-cec1-42b1-93d5-147f0680ac38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:10.993491 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31863d06-cec1-42b1-93d5-147f0680ac38 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:11.079590 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99bfca-c35d-4f93-9ff9-80f893363caa None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:11.116638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 183/353] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:11.117908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1324537-ab82-4311-ba4e-1b2cd376424b None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:11.118195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1324537-ab82-4311-ba4e-1b2cd376424b None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:11.118471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1324537-ab82-4311-ba4e-1b2cd376424b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:11.133886 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301866c-68b6-430e-9673-427ed7483d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:11.134697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301866c-68b6-430e-9673-427ed7483d55 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:11.134903 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301866c-68b6-430e-9673-427ed7483d55 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:11.135178 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301866c-68b6-430e-9673-427ed7483d55 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:11.135936 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301866c-68b6-430e-9673-427ed7483d55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:11.136358 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301866c-68b6-430e-9673-427ed7483d55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:11.137751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301866c-68b6-430e-9673-427ed7483d55 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:11.140541 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-a1324537-ab82-4311-ba4e-1b2cd376424b None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:11.141739 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-a1324537-ab82-4311-ba4e-1b2cd376424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:11.147505 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 171/354] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:11.148876 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301866c-68b6-430e-9673-427ed7483d55 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:11.215943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 184/355] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:11.216856 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1324537-ab82-4311-ba4e-1b2cd376424b None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:11.263412 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301866c-68b6-430e-9673-427ed7483d55 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:11.305267 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8976dc-a18c-470e-9a6e-5b1bf41aa3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:11.305927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8976dc-a18c-470e-9a6e-5b1bf41aa3ee None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:11.306210 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8976dc-a18c-470e-9a6e-5b1bf41aa3ee None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:11.306528 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8976dc-a18c-470e-9a6e-5b1bf41aa3ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:11.331574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1324537-ab82-4311-ba4e-1b2cd376424b None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:11.373649 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f94e9-5d68-4c04-9371-ce7c54b87393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:11.374404 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f94e9-5d68-4c04-9371-ce7c54b87393 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:11.376258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f94e9-5d68-4c04-9371-ce7c54b87393 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:11.376258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f94e9-5d68-4c04-9371-ce7c54b87393 None admin] PATH_INFO: `/v3/groups/0250f650ee6d4460b749cd96e38971f2` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:11.384219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f94e9-5d68-4c04-9371-ce7c54b87393 None admin] RBAC: Authorizing `identity:get_group(group_id=0250f650ee6d4460b749cd96e38971f2)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:11.386833 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f94e9-5d68-4c04-9371-ce7c54b87393 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:11.389241 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 185/356] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Apr 29 20:00:11 2022] GET /identity/v3/groups/0250f650ee6d4460b749cd96e38971f2 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:11.389843 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f94e9-5d68-4c04-9371-ce7c54b87393 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:11.390277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8976dc-a18c-470e-9a6e-5b1bf41aa3ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:11.391734 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8976dc-a18c-470e-9a6e-5b1bf41aa3ee None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:11.499530 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 172/357] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:11.501836 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84412f20-7245-4a13-b672-37cf4211afb2 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:11.502121 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84412f20-7245-4a13-b672-37cf4211afb2 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:11.502400 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84412f20-7245-4a13-b672-37cf4211afb2 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:11.503850 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 173/358] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:11.504429 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84412f20-7245-4a13-b672-37cf4211afb2 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:11.505275 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f94e9-5d68-4c04-9371-ce7c54b87393 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:11.542304 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3855bb-d7e0-4515-a85f-a97a8a3efba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:11.543173 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3855bb-d7e0-4515-a85f-a97a8a3efba6 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:11.543452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3855bb-d7e0-4515-a85f-a97a8a3efba6 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:11.544228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3855bb-d7e0-4515-a85f-a97a8a3efba6 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:11.545099 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3855bb-d7e0-4515-a85f-a97a8a3efba6 None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:11.547538 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3855bb-d7e0-4515-a85f-a97a8a3efba6 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:11.549488 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 186/359] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:11 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:11.550327 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3855bb-d7e0-4515-a85f-a97a8a3efba6 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:11.612813 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84412f20-7245-4a13-b672-37cf4211afb2 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:11.653453 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8b891-94ce-4ecd-a787-52b60e46ce47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:11.654068 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8b891-94ce-4ecd-a787-52b60e46ce47 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:11.654373 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8b891-94ce-4ecd-a787-52b60e46ce47 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:11.654688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8b891-94ce-4ecd-a787-52b60e46ce47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:11.664243 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3855bb-d7e0-4515-a85f-a97a8a3efba6 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:11.698758 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efb30b-0cbd-4635-96e6-46bbcf57b72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:11.699560 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efb30b-0cbd-4635-96e6-46bbcf57b72b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:11.699842 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efb30b-0cbd-4635-96e6-46bbcf57b72b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:11.700167 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efb30b-0cbd-4635-96e6-46bbcf57b72b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:11.711034 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efb30b-0cbd-4635-96e6-46bbcf57b72b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-d4efb30b-0cbd-4635-96e6-46bbcf57b72b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:11.718920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:11.719865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:11.720818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:11.720818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:11.720818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:11.720818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:11.720818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:11.720818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:11.720818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:11.720818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:11.720818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:11.720818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:11.720818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 29 20:00:11.720818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:11.720818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 187/360] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:11.721498 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efb30b-0cbd-4635-96e6-46bbcf57b72b None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:11.733269 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8b891-94ce-4ecd-a787-52b60e46ce47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:11.735062 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8b891-94ce-4ecd-a787-52b60e46ce47 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:11.836129 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efb30b-0cbd-4635-96e6-46bbcf57b72b None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:11.844809 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 174/361] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:11.845656 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8b891-94ce-4ecd-a787-52b60e46ce47 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:11.879309 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c036c-2084-4c86-a836-881aa9fd12f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:11.879969 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c036c-2084-4c86-a836-881aa9fd12f4 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:11.880274 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c036c-2084-4c86-a836-881aa9fd12f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:11.880551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c036c-2084-4c86-a836-881aa9fd12f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:11.881377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c036c-2084-4c86-a836-881aa9fd12f4 None admin] RBAC: Adding query filter params (group.id=0250f650ee6d4460b749cd96e38971f2, role.id=9487c6d4fd524d9bae767533a1315b15, scope.project.id=68ea978bc82b479ea618aa819bb351fc) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:11.881694 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c036c-2084-4c86-a836-881aa9fd12f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:11.883181 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c036c-2084-4c86-a836-881aa9fd12f4 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:11.888573 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 188/362] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Apr 29 20:00:11 2022] GET /identity/v3/role_assignments?group.id=0250f650ee6d4460b749cd96e38971f2&scope.project.id=68ea978bc82b479ea618aa819bb351fc&role.id=9487c6d4fd524d9bae767533a1315b15 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:11.900551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675de75-c45f-477b-92f4-f8c048a945c9 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:11.900551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675de75-c45f-477b-92f4-f8c048a945c9 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:11.900551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675de75-c45f-477b-92f4-f8c048a945c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:11.907358 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-9675de75-c45f-477b-92f4-f8c048a945c9 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:11.908631 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-9675de75-c45f-477b-92f4-f8c048a945c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:11.951047 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8b891-94ce-4ecd-a787-52b60e46ce47 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:11.981402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 189/363] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:11.982272 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675de75-c45f-477b-92f4-f8c048a945c9 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:12.000232 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2f36b-9934-4aa1-a223-91b028f520f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:12.001769 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2f36b-9934-4aa1-a223-91b028f520f4 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:12.002253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2f36b-9934-4aa1-a223-91b028f520f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:12.002746 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2f36b-9934-4aa1-a223-91b028f520f4 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:12.005049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2f36b-9934-4aa1-a223-91b028f520f4 None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:12.007022 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2f36b-9934-4aa1-a223-91b028f520f4 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:12.009873 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 175/364] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:11 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:12.015125 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2f36b-9934-4aa1-a223-91b028f520f4 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:12.090588 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675de75-c45f-477b-92f4-f8c048a945c9 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:12.119819 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2f36b-9934-4aa1-a223-91b028f520f4 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:12.125731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab937f1f-dd98-4c9d-8e67-1446a2745e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:12.126583 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab937f1f-dd98-4c9d-8e67-1446a2745e6a None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:12.126862 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab937f1f-dd98-4c9d-8e67-1446a2745e6a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:12.127133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab937f1f-dd98-4c9d-8e67-1446a2745e6a None admin] PATH_INFO: `/v3/groups/0250f650ee6d4460b749cd96e38971f2` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:12.128343 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab937f1f-dd98-4c9d-8e67-1446a2745e6a None admin] RBAC: Authorizing `identity:get_group(group_id=0250f650ee6d4460b749cd96e38971f2)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:12.129796 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab937f1f-dd98-4c9d-8e67-1446a2745e6a None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:12.136011 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 190/365] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Apr 29 20:00:11 2022] GET /identity/v3/groups/0250f650ee6d4460b749cd96e38971f2 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:12.136011 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab937f1f-dd98-4c9d-8e67-1446a2745e6a None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:12.160104 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701431e9-596d-4861-81f6-a407cd4ab998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:12.160770 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701431e9-596d-4861-81f6-a407cd4ab998 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:12.162709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701431e9-596d-4861-81f6-a407cd4ab998 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:12.162709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701431e9-596d-4861-81f6-a407cd4ab998 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:12.162709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701431e9-596d-4861-81f6-a407cd4ab998 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:12.162709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701431e9-596d-4861-81f6-a407cd4ab998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:12.163728 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701431e9-596d-4861-81f6-a407cd4ab998 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:12.175961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 176/366] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 20:00:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:12.175961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701431e9-596d-4861-81f6-a407cd4ab998 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:12.251452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab937f1f-dd98-4c9d-8e67-1446a2745e6a None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:12.269617 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701431e9-596d-4861-81f6-a407cd4ab998 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:12.285134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d9157-75f1-4dd0-ab06-e381ff7de2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:12.285995 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d9157-75f1-4dd0-ab06-e381ff7de2ca None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:12.286274 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d9157-75f1-4dd0-ab06-e381ff7de2ca None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:12.286544 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d9157-75f1-4dd0-ab06-e381ff7de2ca None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:12.287729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d9157-75f1-4dd0-ab06-e381ff7de2ca None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:12.289739 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d9157-75f1-4dd0-ab06-e381ff7de2ca None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:12.295751 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 191/367] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:12 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:12.295751 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d9157-75f1-4dd0-ab06-e381ff7de2ca None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:12.313099 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524cf0e-38c9-41ea-9269-03a2f8233f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:12.314185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524cf0e-38c9-41ea-9269-03a2f8233f3a None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:12.314468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524cf0e-38c9-41ea-9269-03a2f8233f3a None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:12.314740 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524cf0e-38c9-41ea-9269-03a2f8233f3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:12.327425 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524cf0e-38c9-41ea-9269-03a2f8233f3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-2524cf0e-38c9-41ea-9269-03a2f8233f3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:12.337158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:12.338028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:12.338977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:12.338977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:12.338977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:12.338977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:12.338977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:12.338977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:12.338977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:12.338977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:12.338977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:12.338977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:12.338977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:00:12.338977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:12.338977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 177/368] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 20:00:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:12.345181 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524cf0e-38c9-41ea-9269-03a2f8233f3a None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:12.395452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d9157-75f1-4dd0-ab06-e381ff7de2ca None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:12.434338 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db054724-223f-4596-b457-0284663f2d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:12.435378 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db054724-223f-4596-b457-0284663f2d98 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:12.435753 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db054724-223f-4596-b457-0284663f2d98 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:12.436165 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db054724-223f-4596-b457-0284663f2d98 None admin] PATH_INFO: `/v3/groups/0250f650ee6d4460b749cd96e38971f2` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:12.437450 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db054724-223f-4596-b457-0284663f2d98 None admin] RBAC: Authorizing `identity:get_group(group_id=0250f650ee6d4460b749cd96e38971f2)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:12.439009 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db054724-223f-4596-b457-0284663f2d98 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:12.440759 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 192/369] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Apr 29 20:00:12 2022] GET /identity/v3/groups/0250f650ee6d4460b749cd96e38971f2 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:12.441610 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db054724-223f-4596-b457-0284663f2d98 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:12.454527 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524cf0e-38c9-41ea-9269-03a2f8233f3a None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:12.490315 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22085a06-c116-4c13-93e7-203324a68812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:12.490952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22085a06-c116-4c13-93e7-203324a68812 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:12.491231 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22085a06-c116-4c13-93e7-203324a68812 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:12.491529 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22085a06-c116-4c13-93e7-203324a68812 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:12.492381 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22085a06-c116-4c13-93e7-203324a68812 None admin] RBAC: Adding query filter params (group.id=0250f650ee6d4460b749cd96e38971f2, role.id=a2a640f930c44b2fa40f432179d7faa4, scope.project.id=52da462806f246f2bf40478b710ccc94) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:12.492688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22085a06-c116-4c13-93e7-203324a68812 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:12.494099 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22085a06-c116-4c13-93e7-203324a68812 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:12.499477 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 178/370] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Apr 29 20:00:12 2022] GET /identity/v3/role_assignments?group.id=0250f650ee6d4460b749cd96e38971f2&scope.project.id=52da462806f246f2bf40478b710ccc94&role.id=a2a640f930c44b2fa40f432179d7faa4 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:12.500857 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22085a06-c116-4c13-93e7-203324a68812 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:12.544736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db054724-223f-4596-b457-0284663f2d98 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:12.581590 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db523d1-265b-463e-ab8b-ec70ba0b1bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:12.582656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db523d1-265b-463e-ab8b-ec70ba0b1bc8 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:12.583032 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db523d1-265b-463e-ab8b-ec70ba0b1bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:12.583426 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db523d1-265b-463e-ab8b-ec70ba0b1bc8 None admin] PATH_INFO: `/v3/users/1da50537c4ca4fba99c0ee244a1a8744` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:12.584890 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db523d1-265b-463e-ab8b-ec70ba0b1bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=1da50537c4ca4fba99c0ee244a1a8744)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:12.587036 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db523d1-265b-463e-ab8b-ec70ba0b1bc8 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:12.588945 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 193/371] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Apr 29 20:00:12 2022] GET /identity/v3/users/1da50537c4ca4fba99c0ee244a1a8744 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:12.589875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db523d1-265b-463e-ab8b-ec70ba0b1bc8 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:12.614454 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22085a06-c116-4c13-93e7-203324a68812 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:12.652290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea71e16-8267-4c9b-bc17-6876c857e612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:12.653485 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea71e16-8267-4c9b-bc17-6876c857e612 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:12.653949 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea71e16-8267-4c9b-bc17-6876c857e612 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:12.654398 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea71e16-8267-4c9b-bc17-6876c857e612 None admin] PATH_INFO: `/v3/groups/0250f650ee6d4460b749cd96e38971f2` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:12.655841 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea71e16-8267-4c9b-bc17-6876c857e612 None admin] RBAC: Authorizing `identity:get_group(group_id=0250f650ee6d4460b749cd96e38971f2)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:12.657516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea71e16-8267-4c9b-bc17-6876c857e612 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:12.659841 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 179/372] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Apr 29 20:00:12 2022] GET /identity/v3/groups/0250f650ee6d4460b749cd96e38971f2 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:12.660981 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea71e16-8267-4c9b-bc17-6876c857e612 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:12.712755 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db523d1-265b-463e-ab8b-ec70ba0b1bc8 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:12.747693 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5877c-e2ea-460a-a699-7d58d1d00af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:12.748400 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5877c-e2ea-460a-a699-7d58d1d00af6 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:12.748679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5877c-e2ea-460a-a699-7d58d1d00af6 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:12.748948 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5877c-e2ea-460a-a699-7d58d1d00af6 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:12.749682 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5877c-e2ea-460a-a699-7d58d1d00af6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:12.749979 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5877c-e2ea-460a-a699-7d58d1d00af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:12.751356 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5877c-e2ea-460a-a699-7d58d1d00af6 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:12.762199 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 194/373] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:12.763300 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5877c-e2ea-460a-a699-7d58d1d00af6 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:12.773390 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea71e16-8267-4c9b-bc17-6876c857e612 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:12.811128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805f22d-4c96-4eb2-b147-d8eb5a18457d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:12.812586 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805f22d-4c96-4eb2-b147-d8eb5a18457d None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:12.812875 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805f22d-4c96-4eb2-b147-d8eb5a18457d None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:12.813154 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805f22d-4c96-4eb2-b147-d8eb5a18457d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:12.813987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805f22d-4c96-4eb2-b147-d8eb5a18457d None admin] RBAC: Adding query filter params (group.id=0250f650ee6d4460b749cd96e38971f2, role.id=a2a640f930c44b2fa40f432179d7faa4, scope.project.id=68ea978bc82b479ea618aa819bb351fc) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:12.814513 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805f22d-4c96-4eb2-b147-d8eb5a18457d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:12.815835 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805f22d-4c96-4eb2-b147-d8eb5a18457d None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:12.822559 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 180/374] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Apr 29 20:00:12 2022] GET /identity/v3/role_assignments?group.id=0250f650ee6d4460b749cd96e38971f2&scope.project.id=68ea978bc82b479ea618aa819bb351fc&role.id=a2a640f930c44b2fa40f432179d7faa4 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:12.823595 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805f22d-4c96-4eb2-b147-d8eb5a18457d None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:12.899458 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5877c-e2ea-460a-a699-7d58d1d00af6 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:12.929000 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805f22d-4c96-4eb2-b147-d8eb5a18457d None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:12.960435 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc717e-bb44-498c-a0e4-44e5951190c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:12.961357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc717e-bb44-498c-a0e4-44e5951190c2 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:12.961885 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc717e-bb44-498c-a0e4-44e5951190c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:12.962394 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc717e-bb44-498c-a0e4-44e5951190c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:12.963433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc717e-bb44-498c-a0e4-44e5951190c2 None admin] RBAC: Adding query filter params (role.id=a82cefb7fdd14179a308031eb40d7e48, user.id=1da50537c4ca4fba99c0ee244a1a8744, scope.system=all) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:12.964040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc717e-bb44-498c-a0e4-44e5951190c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:12.964521 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fea43-a441-4971-8e43-85bce8ff430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:12.965174 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fea43-a441-4971-8e43-85bce8ff430d None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:12.965635 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fea43-a441-4971-8e43-85bce8ff430d None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:12.965921 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fea43-a441-4971-8e43-85bce8ff430d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:12.966282 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc717e-bb44-498c-a0e4-44e5951190c2 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:12.966801 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fea43-a441-4971-8e43-85bce8ff430d None admin] RBAC: Adding query filter params (group.id=0250f650ee6d4460b749cd96e38971f2, role.id=9487c6d4fd524d9bae767533a1315b15, scope.project.id=52da462806f246f2bf40478b710ccc94) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:12.967118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fea43-a441-4971-8e43-85bce8ff430d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:12.968745 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fea43-a441-4971-8e43-85bce8ff430d None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:12.976721 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 181/375] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Apr 29 20:00:12 2022] GET /identity/v3/role_assignments?group.id=0250f650ee6d4460b749cd96e38971f2&scope.project.id=52da462806f246f2bf40478b710ccc94&role.id=9487c6d4fd524d9bae767533a1315b15 => generated 260 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:12.976721 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fea43-a441-4971-8e43-85bce8ff430d None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:12.993054 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 195/376] 10.222.0.58 () {56 vars in 1308 bytes} [Fri Apr 29 20:00:12 2022] GET /identity/v3/role_assignments?user.id=1da50537c4ca4fba99c0ee244a1a8744&scope.system=all&role.id=a82cefb7fdd14179a308031eb40d7e48 => generated 510 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:13.139130 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fea43-a441-4971-8e43-85bce8ff430d None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:13.186972 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f334d-4079-419a-8176-6a3b763607b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:13.187581 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f334d-4079-419a-8176-6a3b763607b5 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:13.187864 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f334d-4079-419a-8176-6a3b763607b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:13.188168 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f334d-4079-419a-8176-6a3b763607b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:13.269263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f334d-4079-419a-8176-6a3b763607b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:13.270743 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f334d-4079-419a-8176-6a3b763607b5 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:13.411805 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 182/377] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:13.417441 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc717e-bb44-498c-a0e4-44e5951190c2 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:13.530457 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc717e-bb44-498c-a0e4-44e5951190c2 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:13.565186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb19a4b-b31b-4966-860a-1607dc089fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:13.566871 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb19a4b-b31b-4966-860a-1607dc089fcf None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:13.567350 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb19a4b-b31b-4966-860a-1607dc089fcf None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:13.567825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb19a4b-b31b-4966-860a-1607dc089fcf None admin] PATH_INFO: `/v3/projects/1e417b1278554b3d876c18d3b8c537fa` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:13.569299 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb19a4b-b31b-4966-860a-1607dc089fcf None admin] RBAC: Authorizing `identity:get_project(project_id=1e417b1278554b3d876c18d3b8c537fa)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:13.570974 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb19a4b-b31b-4966-860a-1607dc089fcf None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:13.573286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 196/378] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:13 2022] GET /identity/v3/projects/1e417b1278554b3d876c18d3b8c537fa => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:13.581117 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f334d-4079-419a-8176-6a3b763607b5 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:13.702265 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f334d-4079-419a-8176-6a3b763607b5 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:13.746089 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d18e7b-61f1-4fa8-8519-209bb1ca7159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:13.747301 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d18e7b-61f1-4fa8-8519-209bb1ca7159 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:13.747810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d18e7b-61f1-4fa8-8519-209bb1ca7159 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:13.748317 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d18e7b-61f1-4fa8-8519-209bb1ca7159 None admin] PATH_INFO: `/v3/groups/d53754eeaaf1483486207e0978bb04ef` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:13.760247 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d18e7b-61f1-4fa8-8519-209bb1ca7159 None admin] RBAC: Authorizing `identity:get_group(group_id=d53754eeaaf1483486207e0978bb04ef)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:13.762003 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d18e7b-61f1-4fa8-8519-209bb1ca7159 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:13.763883 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 183/379] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Apr 29 20:00:13 2022] GET /identity/v3/groups/d53754eeaaf1483486207e0978bb04ef => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:13.769693 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb19a4b-b31b-4966-860a-1607dc089fcf None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:13.879773 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb19a4b-b31b-4966-860a-1607dc089fcf None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:13.916107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c737674-0eb4-41aa-bd89-29e48005ae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:13.917126 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c737674-0eb4-41aa-bd89-29e48005ae7a None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:13.917605 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c737674-0eb4-41aa-bd89-29e48005ae7a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:13.918113 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c737674-0eb4-41aa-bd89-29e48005ae7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:13.919139 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c737674-0eb4-41aa-bd89-29e48005ae7a None admin] RBAC: Adding query filter params (group.id=d53754eeaaf1483486207e0978bb04ef, role.id=5255ed3fa613448fb4c549f5bc7f20af, scope.project.id=1e417b1278554b3d876c18d3b8c537fa) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:13.919645 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c737674-0eb4-41aa-bd89-29e48005ae7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:13.921292 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c737674-0eb4-41aa-bd89-29e48005ae7a None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:13.927838 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 197/380] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Apr 29 20:00:13 2022] GET /identity/v3/role_assignments?group.id=d53754eeaaf1483486207e0978bb04ef&scope.project.id=1e417b1278554b3d876c18d3b8c537fa&role.id=5255ed3fa613448fb4c549f5bc7f20af => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:14.599753 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c0b78-6228-4d98-a525-ba1dd0f3aea8 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:14.599935 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c0b78-6228-4d98-a525-ba1dd0f3aea8 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:14.600258 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c0b78-6228-4d98-a525-ba1dd0f3aea8 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:14.602298 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 184/381] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:14.607838 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f68db6-1713-481f-ac53-958ccd8b111c None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:14.608296 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f68db6-1713-481f-ac53-958ccd8b111c None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:14.608446 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f68db6-1713-481f-ac53-958ccd8b111c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:14.637048 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-42f68db6-1713-481f-ac53-958ccd8b111c None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:14.638255 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-42f68db6-1713-481f-ac53-958ccd8b111c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:14.724269 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 198/382] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:14.774261 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c0b78-6228-4d98-a525-ba1dd0f3aea8 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:14.884635 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c0b78-6228-4d98-a525-ba1dd0f3aea8 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:14.925068 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e52e5f-a6d2-4f8f-be49-dd4fdc576055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:14.925899 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e52e5f-a6d2-4f8f-be49-dd4fdc576055 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:14.926164 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e52e5f-a6d2-4f8f-be49-dd4fdc576055 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:14.926439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e52e5f-a6d2-4f8f-be49-dd4fdc576055 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:14.937564 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e52e5f-a6d2-4f8f-be49-dd4fdc576055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-54e52e5f-a6d2-4f8f-be49-dd4fdc576055 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:14.945952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:14.946920 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:14.947714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:14.947714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:14.947714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:14.947714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:14.947714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:14.947714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:14.947714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:14.947714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:14.947714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:14.947714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:14.947714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 20:00:14.947714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:14.947714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 185/383] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 20:00:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:14.953361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f68db6-1713-481f-ac53-958ccd8b111c None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:15.066857 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f68db6-1713-481f-ac53-958ccd8b111c None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:15.111151 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdac82-9d1a-4828-9e06-546086bf2c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:15.111833 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdac82-9d1a-4828-9e06-546086bf2c5c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:15.112141 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdac82-9d1a-4828-9e06-546086bf2c5c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:15.112403 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdac82-9d1a-4828-9e06-546086bf2c5c None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:15.113183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdac82-9d1a-4828-9e06-546086bf2c5c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:15.113484 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdac82-9d1a-4828-9e06-546086bf2c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:15.114869 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdac82-9d1a-4828-9e06-546086bf2c5c None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:15.125880 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 199/384] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:15.131302 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e52e5f-a6d2-4f8f-be49-dd4fdc576055 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:15.244443 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e52e5f-a6d2-4f8f-be49-dd4fdc576055 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:15.283493 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b424b8a-b49b-4040-aac0-8a12f825a4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:15.284415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b424b8a-b49b-4040-aac0-8a12f825a4cc None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:15.284695 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b424b8a-b49b-4040-aac0-8a12f825a4cc None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:15.284971 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b424b8a-b49b-4040-aac0-8a12f825a4cc None admin] PATH_INFO: `/v3/groups/0250f650ee6d4460b749cd96e38971f2` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:15.286273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b424b8a-b49b-4040-aac0-8a12f825a4cc None admin] RBAC: Authorizing `identity:get_group(group_id=0250f650ee6d4460b749cd96e38971f2)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:15.287769 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b424b8a-b49b-4040-aac0-8a12f825a4cc None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:15.290083 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 186/385] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Apr 29 20:00:15 2022] GET /identity/v3/groups/0250f650ee6d4460b749cd96e38971f2 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:15.295874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdac82-9d1a-4828-9e06-546086bf2c5c None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:15.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdac82-9d1a-4828-9e06-546086bf2c5c None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:15.485011 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdb691-fb81-40bc-afcd-cf6201d88955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:15.486969 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdb691-fb81-40bc-afcd-cf6201d88955 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:15.487250 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdb691-fb81-40bc-afcd-cf6201d88955 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:15.487521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdb691-fb81-40bc-afcd-cf6201d88955 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:15.488761 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdb691-fb81-40bc-afcd-cf6201d88955 None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:15.490214 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdb691-fb81-40bc-afcd-cf6201d88955 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:15.491957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 200/386] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:15 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:15.497831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b424b8a-b49b-4040-aac0-8a12f825a4cc None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:15.509625 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce622e16-f33c-4696-88ed-5d8dbe674c48 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:15.509927 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce622e16-f33c-4696-88ed-5d8dbe674c48 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:15.510183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce622e16-f33c-4696-88ed-5d8dbe674c48 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:15.511553 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 201/387] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:15.516859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aff5d-dea7-4ef6-8f46-f045bdc71fdc None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:15.517146 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aff5d-dea7-4ef6-8f46-f045bdc71fdc None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:15.517427 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aff5d-dea7-4ef6-8f46-f045bdc71fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:15.544861 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-535aff5d-dea7-4ef6-8f46-f045bdc71fdc None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:15.546035 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-535aff5d-dea7-4ef6-8f46-f045bdc71fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:15.640078 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b424b8a-b49b-4040-aac0-8a12f825a4cc None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:15.687862 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 202/388] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 20:00:15.704604 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5ffd2-ef73-45da-b0af-245be8412850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:15.705530 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5ffd2-ef73-45da-b0af-245be8412850 None admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:15.705811 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5ffd2-ef73-45da-b0af-245be8412850 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:15.706084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5ffd2-ef73-45da-b0af-245be8412850 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc/groups/0250f650ee6d4460b749cd96e38971f2/roles/9487c6d4fd524d9bae767533a1315b15` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:15.710024 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5ffd2-ef73-45da-b0af-245be8412850 None admin] RBAC: Authorizing `identity:create_grant(project_id=68ea978bc82b479ea618aa819bb351fc, group_id=0250f650ee6d4460b749cd96e38971f2, role_id=9487c6d4fd524d9bae767533a1315b15)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:15.712412 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aff5d-dea7-4ef6-8f46-f045bdc71fdc None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:15.717254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5ffd2-ef73-45da-b0af-245be8412850 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:15.810779 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 187/389] 10.222.0.58 () {58 vars in 1442 bytes} [Fri Apr 29 20:00:15 2022] PUT /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc/groups/0250f650ee6d4460b749cd96e38971f2/roles/9487c6d4fd524d9bae767533a1315b15 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:00:15.832425 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aff5d-dea7-4ef6-8f46-f045bdc71fdc None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:15.871525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa9ef-2b1a-44ba-86af-ed31ed004ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:15.872618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa9ef-2b1a-44ba-86af-ed31ed004ab5 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:15.872618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa9ef-2b1a-44ba-86af-ed31ed004ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:15.872954 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa9ef-2b1a-44ba-86af-ed31ed004ab5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:15.883912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aa9ef-2b1a-44ba-86af-ed31ed004ab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-541aa9ef-2b1a-44ba-86af-ed31ed004ab5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:15.892089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:15.894043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:15.895183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:15.895183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:15.895183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:15.895183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:15.895183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:15.895183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:15.895183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:15.895183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:15.895183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:15.895183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:15.895183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:15.895183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:15.895922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cdbd0-c54c-42e2-a3ca-aca3bb7c7cb1 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:15.895922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cdbd0-c54c-42e2-a3ca-aca3bb7c7cb1 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:15.896104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 203/390] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:15.896184 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cdbd0-c54c-42e2-a3ca-aca3bb7c7cb1 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:15.896184 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 188/391] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:15.899541 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa9ef-2b1a-44ba-86af-ed31ed004ab5 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:15.902453 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4382f-cb4f-46d3-8d6b-3a29be1a54d9 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:15.902762 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4382f-cb4f-46d3-8d6b-3a29be1a54d9 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:15.903004 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4382f-cb4f-46d3-8d6b-3a29be1a54d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:15.932831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-0fc4382f-cb4f-46d3-8d6b-3a29be1a54d9 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:15.940073 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-0fc4382f-cb4f-46d3-8d6b-3a29be1a54d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:16.008601 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa9ef-2b1a-44ba-86af-ed31ed004ab5 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:16.044402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5be660-f2d8-452f-ae57-1942703641f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:16.045078 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5be660-f2d8-452f-ae57-1942703641f1 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:16.045358 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5be660-f2d8-452f-ae57-1942703641f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:16.045631 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5be660-f2d8-452f-ae57-1942703641f1 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:16.046448 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5be660-f2d8-452f-ae57-1942703641f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:16.046754 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5be660-f2d8-452f-ae57-1942703641f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:16.048277 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5be660-f2d8-452f-ae57-1942703641f1 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:16.056415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 189/392] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:16.056833 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 204/393] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 20:00:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:16.062556 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4382f-cb4f-46d3-8d6b-3a29be1a54d9 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:16.081321 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5be660-f2d8-452f-ae57-1942703641f1 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:16.165368 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4382f-cb4f-46d3-8d6b-3a29be1a54d9 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:16.186105 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5be660-f2d8-452f-ae57-1942703641f1 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:16.218679 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4c68-e6c5-4bda-b7e1-e987917178d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:16.218679 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4c68-e6c5-4bda-b7e1-e987917178d6 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:16.218679 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4c68-e6c5-4bda-b7e1-e987917178d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:16.218679 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4c68-e6c5-4bda-b7e1-e987917178d6 None admin] PATH_INFO: `/v3/groups/0250f650ee6d4460b749cd96e38971f2` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:16.223223 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d4c68-e6c5-4bda-b7e1-e987917178d6 None admin] RBAC: Authorizing `identity:get_group(group_id=0250f650ee6d4460b749cd96e38971f2)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:16.223367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c5952-571a-4abc-87e9-dbfe5e8bb759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:16.223537 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d4c68-e6c5-4bda-b7e1-e987917178d6 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:16.223681 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c5952-571a-4abc-87e9-dbfe5e8bb759 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:16.223681 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c5952-571a-4abc-87e9-dbfe5e8bb759 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:16.223681 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c5952-571a-4abc-87e9-dbfe5e8bb759 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:16.224115 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 190/394] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Apr 29 20:00:16 2022] GET /identity/v3/groups/0250f650ee6d4460b749cd96e38971f2 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:16.229242 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4c68-e6c5-4bda-b7e1-e987917178d6 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:16.233368 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c5952-571a-4abc-87e9-dbfe5e8bb759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-664c5952-571a-4abc-87e9-dbfe5e8bb759 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:16.242157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:16.246228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:16.248169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:16.248169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:16.248169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:16.248169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:16.248169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:16.248169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:16.248169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:16.248169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:16.248169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:16.248169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:16.248169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:16.248169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:16.248169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 205/395] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:16.256003 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c5952-571a-4abc-87e9-dbfe5e8bb759 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:16.415682 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c5952-571a-4abc-87e9-dbfe5e8bb759 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:16.470290 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58712c-a690-420d-978d-7fed3bbeda0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:16.470968 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58712c-a690-420d-978d-7fed3bbeda0b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:16.471248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58712c-a690-420d-978d-7fed3bbeda0b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:16.471523 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58712c-a690-420d-978d-7fed3bbeda0b None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:16.472309 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58712c-a690-420d-978d-7fed3bbeda0b None admin] RBAC: Adding query filter params (name=member) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:16.472619 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58712c-a690-420d-978d-7fed3bbeda0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:16.480405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58712c-a690-420d-978d-7fed3bbeda0b None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:16.496644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 206/396] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 20:00:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:16.498010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a997ace-1d9a-4e63-aeb2-d62ba82a6ef4 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:16.498298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a997ace-1d9a-4e63-aeb2-d62ba82a6ef4 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:16.498568 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a997ace-1d9a-4e63-aeb2-d62ba82a6ef4 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:16.500039 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 207/397] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:16.504381 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a997ace-1d9a-4e63-aeb2-d62ba82a6ef4 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:16.508211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4c68-e6c5-4bda-b7e1-e987917178d6 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:16.548486 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b1f5c-29e8-4cc6-bb63-d6e028bc9ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:16.549849 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b1f5c-29e8-4cc6-bb63-d6e028bc9ee3 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:16.550202 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b1f5c-29e8-4cc6-bb63-d6e028bc9ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:16.550553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b1f5c-29e8-4cc6-bb63-d6e028bc9ee3 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:16.552397 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b1f5c-29e8-4cc6-bb63-d6e028bc9ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:16.554485 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b1f5c-29e8-4cc6-bb63-d6e028bc9ee3 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:16.557392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 191/398] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:16 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:16.558724 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830c405-dcb9-4f82-ba85-dd12153c878c None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:16.559076 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830c405-dcb9-4f82-ba85-dd12153c878c None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:16.559428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830c405-dcb9-4f82-ba85-dd12153c878c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:16.582875 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-6830c405-dcb9-4f82-ba85-dd12153c878c None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:16.584230 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-6830c405-dcb9-4f82-ba85-dd12153c878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:16.611372 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a997ace-1d9a-4e63-aeb2-d62ba82a6ef4 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:16.644450 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504ce9-94c9-42d5-a3fb-1b9861249e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:16.645314 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504ce9-94c9-42d5-a3fb-1b9861249e04 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:16.645582 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504ce9-94c9-42d5-a3fb-1b9861249e04 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:16.645853 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504ce9-94c9-42d5-a3fb-1b9861249e04 None admin] PATH_INFO: `/v3/groups/0250f650ee6d4460b749cd96e38971f2` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:16.647036 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f504ce9-94c9-42d5-a3fb-1b9861249e04 None admin] RBAC: Authorizing `identity:get_group(group_id=0250f650ee6d4460b749cd96e38971f2)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:16.649061 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f504ce9-94c9-42d5-a3fb-1b9861249e04 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:16.650985 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 208/399] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Apr 29 20:00:16 2022] GET /identity/v3/groups/0250f650ee6d4460b749cd96e38971f2 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:16.651793 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504ce9-94c9-42d5-a3fb-1b9861249e04 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:16.669600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 192/400] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:16.672799 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830c405-dcb9-4f82-ba85-dd12153c878c None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:16.776727 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830c405-dcb9-4f82-ba85-dd12153c878c None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:16.792456 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504ce9-94c9-42d5-a3fb-1b9861249e04 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:16.820174 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1636ec-a5cb-4c53-8a0d-ca3a5b28108f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:16.821959 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1636ec-a5cb-4c53-8a0d-ca3a5b28108f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:16.822546 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1636ec-a5cb-4c53-8a0d-ca3a5b28108f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:16.822989 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1636ec-a5cb-4c53-8a0d-ca3a5b28108f None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:16.825595 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1636ec-a5cb-4c53-8a0d-ca3a5b28108f None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:16.828136 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1636ec-a5cb-4c53-8a0d-ca3a5b28108f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:16.828433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ed1d5-a699-409f-b880-eef03c0e8788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:16.829419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ed1d5-a699-409f-b880-eef03c0e8788 None admin] REQUEST_METHOD: `PUT` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:16.829802 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ed1d5-a699-409f-b880-eef03c0e8788 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:16.830194 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ed1d5-a699-409f-b880-eef03c0e8788 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94/groups/0250f650ee6d4460b749cd96e38971f2/roles/a2a640f930c44b2fa40f432179d7faa4` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:16.831326 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 193/401] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:16 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:16.832491 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ed1d5-a699-409f-b880-eef03c0e8788 None admin] RBAC: Authorizing `identity:create_grant(project_id=52da462806f246f2bf40478b710ccc94, group_id=0250f650ee6d4460b749cd96e38971f2, role_id=a2a640f930c44b2fa40f432179d7faa4)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:16.833223 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1636ec-a5cb-4c53-8a0d-ca3a5b28108f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:16.834131 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ed1d5-a699-409f-b880-eef03c0e8788 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:16.896314 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 209/402] 10.222.0.58 () {58 vars in 1442 bytes} [Fri Apr 29 20:00:16 2022] PUT /identity/v3/projects/52da462806f246f2bf40478b710ccc94/groups/0250f650ee6d4460b749cd96e38971f2/roles/a2a640f930c44b2fa40f432179d7faa4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:00:16.897296 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ed1d5-a699-409f-b880-eef03c0e8788 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:16.946198 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1636ec-a5cb-4c53-8a0d-ca3a5b28108f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:17.000910 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d836f-3394-4afa-bdd5-b06dfd4d3bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:17.002035 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d836f-3394-4afa-bdd5-b06dfd4d3bb5 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:17.004427 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d836f-3394-4afa-bdd5-b06dfd4d3bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:17.004866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d836f-3394-4afa-bdd5-b06dfd4d3bb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:17.021278 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d836f-3394-4afa-bdd5-b06dfd4d3bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-7b9d836f-3394-4afa-bdd5-b06dfd4d3bb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:17.031138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:17.032129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:17.032930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:17.032930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:17.032930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:17.032930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:17.032930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:17.032930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:17.032930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:17.032930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:17.032930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:17.032930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:17.032930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 20:00:17.032930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:17.040578 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 194/403] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 20:00:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:17.043699 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d836f-3394-4afa-bdd5-b06dfd4d3bb5 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:17.126403 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ed1d5-a699-409f-b880-eef03c0e8788 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:17.168196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e5198-2563-4d2d-be55-b22a49b03ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:17.169457 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e5198-2563-4d2d-be55-b22a49b03ef4 None admin] REQUEST_METHOD: `PUT` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:17.169938 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e5198-2563-4d2d-be55-b22a49b03ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:17.170408 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e5198-2563-4d2d-be55-b22a49b03ef4 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc/groups/0250f650ee6d4460b749cd96e38971f2/roles/a2a640f930c44b2fa40f432179d7faa4` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:17.172637 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e5198-2563-4d2d-be55-b22a49b03ef4 None admin] RBAC: Authorizing `identity:create_grant(project_id=68ea978bc82b479ea618aa819bb351fc, group_id=0250f650ee6d4460b749cd96e38971f2, role_id=a2a640f930c44b2fa40f432179d7faa4)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:17.174325 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e5198-2563-4d2d-be55-b22a49b03ef4 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:17.186788 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d836f-3394-4afa-bdd5-b06dfd4d3bb5 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:17.231984 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27331b-a506-4a5c-927f-7779d1b3d25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:17.232983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27331b-a506-4a5c-927f-7779d1b3d25a None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:17.233444 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27331b-a506-4a5c-927f-7779d1b3d25a None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:17.233907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27331b-a506-4a5c-927f-7779d1b3d25a None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:17.234973 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27331b-a506-4a5c-927f-7779d1b3d25a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:17.235435 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27331b-a506-4a5c-927f-7779d1b3d25a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:17.237633 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27331b-a506-4a5c-927f-7779d1b3d25a None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:17.253872 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 195/404] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:17.253872 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b996670-1440-4cfe-b996-02867362aaae None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:17.253872 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b996670-1440-4cfe-b996-02867362aaae None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:17.253872 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b996670-1440-4cfe-b996-02867362aaae None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:17.254383 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 196/405] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:17.260973 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b996670-1440-4cfe-b996-02867362aaae None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:17.278480 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 210/406] 10.222.0.58 () {58 vars in 1442 bytes} [Fri Apr 29 20:00:16 2022] PUT /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc/groups/0250f650ee6d4460b749cd96e38971f2/roles/a2a640f930c44b2fa40f432179d7faa4 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:00:17.281644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741cc85-21fa-4784-bd8a-55353566d02d None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:17.282346 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741cc85-21fa-4784-bd8a-55353566d02d None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:17.286111 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741cc85-21fa-4784-bd8a-55353566d02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:17.304661 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-8741cc85-21fa-4784-bd8a-55353566d02d None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:17.307042 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-8741cc85-21fa-4784-bd8a-55353566d02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:17.393530 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 211/407] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:17.422079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741cc85-21fa-4784-bd8a-55353566d02d None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:17.461382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b996670-1440-4cfe-b996-02867362aaae None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:17.500134 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f579128-b159-4640-b4aa-e7d96c98eb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:17.502416 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f579128-b159-4640-b4aa-e7d96c98eb65 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:17.502900 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f579128-b159-4640-b4aa-e7d96c98eb65 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:17.503364 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f579128-b159-4640-b4aa-e7d96c98eb65 None admin] PATH_INFO: `/v3/groups/0250f650ee6d4460b749cd96e38971f2` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:17.505087 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f579128-b159-4640-b4aa-e7d96c98eb65 None admin] RBAC: Authorizing `identity:get_group(group_id=0250f650ee6d4460b749cd96e38971f2)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:17.507607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f579128-b159-4640-b4aa-e7d96c98eb65 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:17.514793 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 197/408] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Apr 29 20:00:17 2022] GET /identity/v3/groups/0250f650ee6d4460b749cd96e38971f2 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:17.516586 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f579128-b159-4640-b4aa-e7d96c98eb65 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:17.600196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741cc85-21fa-4784-bd8a-55353566d02d None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:17.635294 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f579128-b159-4640-b4aa-e7d96c98eb65 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:17.636127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a79d9-0f7e-44a5-980d-9679310dbdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:17.637161 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a79d9-0f7e-44a5-980d-9679310dbdb7 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:17.637631 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a79d9-0f7e-44a5-980d-9679310dbdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:17.638088 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a79d9-0f7e-44a5-980d-9679310dbdb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:17.648462 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a79d9-0f7e-44a5-980d-9679310dbdb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-a18a79d9-0f7e-44a5-980d-9679310dbdb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:17.656320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:17.657197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:17.657970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:17.657970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:17.657970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:17.657970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:17.657970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:17.657970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:17.657970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:17.657970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:17.657970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:17.657970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:17.657970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:00:17.657970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:17.660304 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 212/409] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 20:00:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:17.666562 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a79d9-0f7e-44a5-980d-9679310dbdb7 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:17.668840 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f8d85-6698-47aa-b4ba-031da03ec57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:17.669702 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f8d85-6698-47aa-b4ba-031da03ec57a None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:17.669976 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f8d85-6698-47aa-b4ba-031da03ec57a None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:17.670327 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f8d85-6698-47aa-b4ba-031da03ec57a None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:17.672077 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f8d85-6698-47aa-b4ba-031da03ec57a None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:17.672930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f8d85-6698-47aa-b4ba-031da03ec57a None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:17.679258 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 198/410] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:17 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:17.683237 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f8d85-6698-47aa-b4ba-031da03ec57a None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:17.784021 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f8d85-6698-47aa-b4ba-031da03ec57a None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:17.808517 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a79d9-0f7e-44a5-980d-9679310dbdb7 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:17.831391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e843709-94e7-44d2-9dea-b0e392d87da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:17.832936 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e843709-94e7-44d2-9dea-b0e392d87da7 None admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:17.833394 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e843709-94e7-44d2-9dea-b0e392d87da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:17.833863 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e843709-94e7-44d2-9dea-b0e392d87da7 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94/groups/0250f650ee6d4460b749cd96e38971f2/roles/9487c6d4fd524d9bae767533a1315b15` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:17.841178 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e843709-94e7-44d2-9dea-b0e392d87da7 None admin] RBAC: Authorizing `identity:create_grant(project_id=52da462806f246f2bf40478b710ccc94, group_id=0250f650ee6d4460b749cd96e38971f2, role_id=9487c6d4fd524d9bae767533a1315b15)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:17.842722 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed34ce8-15fb-429d-ae99-e79a70a7bda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:17.843068 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e843709-94e7-44d2-9dea-b0e392d87da7 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:17.843686 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed34ce8-15fb-429d-ae99-e79a70a7bda8 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:17.844053 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed34ce8-15fb-429d-ae99-e79a70a7bda8 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:17.844395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed34ce8-15fb-429d-ae99-e79a70a7bda8 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:17.845198 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed34ce8-15fb-429d-ae99-e79a70a7bda8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:17.845566 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed34ce8-15fb-429d-ae99-e79a70a7bda8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:17.846996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed34ce8-15fb-429d-ae99-e79a70a7bda8 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:17.855894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 213/411] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:17.862225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed34ce8-15fb-429d-ae99-e79a70a7bda8 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:17.955818 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 199/412] 10.222.0.58 () {58 vars in 1442 bytes} [Fri Apr 29 20:00:17 2022] PUT /identity/v3/projects/52da462806f246f2bf40478b710ccc94/groups/0250f650ee6d4460b749cd96e38971f2/roles/9487c6d4fd524d9bae767533a1315b15 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:00:17.968291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed34ce8-15fb-429d-ae99-e79a70a7bda8 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:18.006602 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1795a-b45a-4d67-bd57-a27156b2c10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:18.008532 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1795a-b45a-4d67-bd57-a27156b2c10a None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:18.008958 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1795a-b45a-4d67-bd57-a27156b2c10a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:18.009376 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1795a-b45a-4d67-bd57-a27156b2c10a None admin] PATH_INFO: `/v3/groups/d53754eeaaf1483486207e0978bb04ef` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:18.010844 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1795a-b45a-4d67-bd57-a27156b2c10a None admin] RBAC: Authorizing `identity:get_group(group_id=d53754eeaaf1483486207e0978bb04ef)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:18.012597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1795a-b45a-4d67-bd57-a27156b2c10a None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:18.014772 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 214/413] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Apr 29 20:00:17 2022] GET /identity/v3/groups/d53754eeaaf1483486207e0978bb04ef => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:18.020502 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e843709-94e7-44d2-9dea-b0e392d87da7 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:18.189397 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e843709-94e7-44d2-9dea-b0e392d87da7 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:18.221941 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031878aa-dbd7-4723-818b-4c0e5a39d4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:18.222767 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031878aa-dbd7-4723-818b-4c0e5a39d4c9 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:18.223055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031878aa-dbd7-4723-818b-4c0e5a39d4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:18.223327 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031878aa-dbd7-4723-818b-4c0e5a39d4c9 None admin] PATH_INFO: `/v3/projects/1e417b1278554b3d876c18d3b8c537fa` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:18.224623 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031878aa-dbd7-4723-818b-4c0e5a39d4c9 None admin] RBAC: Authorizing `identity:get_project(project_id=1e417b1278554b3d876c18d3b8c537fa)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:18.226614 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031878aa-dbd7-4723-818b-4c0e5a39d4c9 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:18.228759 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 200/414] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:18 2022] GET /identity/v3/projects/1e417b1278554b3d876c18d3b8c537fa => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:18.234502 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1795a-b45a-4d67-bd57-a27156b2c10a None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:18.379641 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1795a-b45a-4d67-bd57-a27156b2c10a None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:18.429651 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadddeda-a754-4002-8c4f-34ff009e095a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:18.430542 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadddeda-a754-4002-8c4f-34ff009e095a None admin] REQUEST_METHOD: `PUT` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:18.430820 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadddeda-a754-4002-8c4f-34ff009e095a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:18.431089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadddeda-a754-4002-8c4f-34ff009e095a None admin] PATH_INFO: `/v3/projects/1e417b1278554b3d876c18d3b8c537fa/groups/d53754eeaaf1483486207e0978bb04ef/roles/5255ed3fa613448fb4c549f5bc7f20af` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:18.437300 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadddeda-a754-4002-8c4f-34ff009e095a None admin] RBAC: Authorizing `identity:create_grant(project_id=1e417b1278554b3d876c18d3b8c537fa, group_id=d53754eeaaf1483486207e0978bb04ef, role_id=5255ed3fa613448fb4c549f5bc7f20af)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:18.438765 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadddeda-a754-4002-8c4f-34ff009e095a None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:18.520820 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 215/415] 10.222.0.58 () {58 vars in 1442 bytes} [Fri Apr 29 20:00:18 2022] PUT /identity/v3/projects/1e417b1278554b3d876c18d3b8c537fa/groups/d53754eeaaf1483486207e0978bb04ef/roles/5255ed3fa613448fb4c549f5bc7f20af => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:00:18.524765 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973947d-a1ed-4c94-b681-a7e35e46bee1 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:18.525051 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973947d-a1ed-4c94-b681-a7e35e46bee1 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:18.525339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973947d-a1ed-4c94-b681-a7e35e46bee1 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:18.526859 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 201/416] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:18.536146 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c3b2b-1eab-47ac-b7c2-15e0efb7aafd None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:18.536146 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c3b2b-1eab-47ac-b7c2-15e0efb7aafd None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:18.536146 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c3b2b-1eab-47ac-b7c2-15e0efb7aafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:18.557356 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-c25c3b2b-1eab-47ac-b7c2-15e0efb7aafd None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:18.558913 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-c25c3b2b-1eab-47ac-b7c2-15e0efb7aafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:18.644535 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 216/417] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:18.685352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973947d-a1ed-4c94-b681-a7e35e46bee1 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:18.835703 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973947d-a1ed-4c94-b681-a7e35e46bee1 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:18.880318 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda61104-66b7-475c-acf1-b46bbc76fa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:18.881177 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda61104-66b7-475c-acf1-b46bbc76fa66 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:18.881456 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda61104-66b7-475c-acf1-b46bbc76fa66 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:18.881724 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda61104-66b7-475c-acf1-b46bbc76fa66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:18.903689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda61104-66b7-475c-acf1-b46bbc76fa66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-eda61104-66b7-475c-acf1-b46bbc76fa66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:18.911927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:18.912957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:18.913812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:18.913812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:18.913812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:18.913812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:18.913812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:18.913812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:18.913812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:18.913812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:18.913812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:18.913812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:18.913812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 20:00:18.913812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:18.913812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 202/418] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 20:00:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:18.919225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c3b2b-1eab-47ac-b7c2-15e0efb7aafd None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:19.070716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c3b2b-1eab-47ac-b7c2-15e0efb7aafd None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:19.114492 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d8c4b-3c38-494e-802f-a6b18cfba881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:19.115215 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d8c4b-3c38-494e-802f-a6b18cfba881 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:19.115498 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d8c4b-3c38-494e-802f-a6b18cfba881 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:19.115824 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d8c4b-3c38-494e-802f-a6b18cfba881 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:19.117199 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d8c4b-3c38-494e-802f-a6b18cfba881 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:19.117499 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d8c4b-3c38-494e-802f-a6b18cfba881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:19.118955 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d8c4b-3c38-494e-802f-a6b18cfba881 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:19.129147 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 217/419] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:19.137201 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda61104-66b7-475c-acf1-b46bbc76fa66 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:19.270479 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda61104-66b7-475c-acf1-b46bbc76fa66 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:19.309505 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f852f-7396-4a19-bd77-95369b104588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:19.310158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f852f-7396-4a19-bd77-95369b104588 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:19.310441 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f852f-7396-4a19-bd77-95369b104588 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:19.310714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f852f-7396-4a19-bd77-95369b104588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:19.423487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f852f-7396-4a19-bd77-95369b104588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:19.424904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f852f-7396-4a19-bd77-95369b104588 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:19.556376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 203/420] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:19.561573 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d8c4b-3c38-494e-802f-a6b18cfba881 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:19.639719 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b6d1f-f504-49c5-b14b-5aaf19955236 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:19.640368 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b6d1f-f504-49c5-b14b-5aaf19955236 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:19.640854 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b6d1f-f504-49c5-b14b-5aaf19955236 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:19.642641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 204/421] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:19.648819 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844e395-d5c6-4646-8d4f-f198bc673f2e None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:19.649100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844e395-d5c6-4646-8d4f-f198bc673f2e None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:19.649378 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844e395-d5c6-4646-8d4f-f198bc673f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:19.674788 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-9844e395-d5c6-4646-8d4f-f198bc673f2e None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:19.676393 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-9844e395-d5c6-4646-8d4f-f198bc673f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:19.713463 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d8c4b-3c38-494e-802f-a6b18cfba881 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:19.764719 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea876185-1ac2-4502-bce5-c770578c9a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:19.765606 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea876185-1ac2-4502-bce5-c770578c9a63 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:19.765885 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea876185-1ac2-4502-bce5-c770578c9a63 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:19.766156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea876185-1ac2-4502-bce5-c770578c9a63 None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:19.767418 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea876185-1ac2-4502-bce5-c770578c9a63 None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:19.768895 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea876185-1ac2-4502-bce5-c770578c9a63 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:19.770895 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 218/422] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:19 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:19.777372 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea876185-1ac2-4502-bce5-c770578c9a63 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:19.779868 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 205/423] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:19.815865 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844e395-d5c6-4646-8d4f-f198bc673f2e None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:19.918684 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea876185-1ac2-4502-bce5-c770578c9a63 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:19.961336 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8261ccf-e4b3-4777-ad15-0c372fa175c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:19.962154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8261ccf-e4b3-4777-ad15-0c372fa175c8 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:19.962438 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8261ccf-e4b3-4777-ad15-0c372fa175c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:19.962710 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8261ccf-e4b3-4777-ad15-0c372fa175c8 None admin] PATH_INFO: `/v3/groups/0250f650ee6d4460b749cd96e38971f2` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:19.965012 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8261ccf-e4b3-4777-ad15-0c372fa175c8 None admin] RBAC: Authorizing `identity:get_group(group_id=0250f650ee6d4460b749cd96e38971f2)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:19.966502 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8261ccf-e4b3-4777-ad15-0c372fa175c8 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:19.968145 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 219/424] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Apr 29 20:00:19 2022] GET /identity/v3/groups/0250f650ee6d4460b749cd96e38971f2 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:19.974071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8261ccf-e4b3-4777-ad15-0c372fa175c8 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:19.995144 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844e395-d5c6-4646-8d4f-f198bc673f2e None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:20.034293 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7ed8c-ce47-4f10-b9f1-559891eccc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:20.040224 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7ed8c-ce47-4f10-b9f1-559891eccc5a None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:20.040224 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7ed8c-ce47-4f10-b9f1-559891eccc5a None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:20.040224 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7ed8c-ce47-4f10-b9f1-559891eccc5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:20.059042 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7ed8c-ce47-4f10-b9f1-559891eccc5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-6fa7ed8c-ce47-4f10-b9f1-559891eccc5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:20.066930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:20.069128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:20.071116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:20.071116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:20.071116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:20.071116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:20.071116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:20.071116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:20.071116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:20.071116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:20.071116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:20.071116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:20.071116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:20.071116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:20.071116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 206/425] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:20.078409 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7ed8c-ce47-4f10-b9f1-559891eccc5a None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:20.175570 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8261ccf-e4b3-4777-ad15-0c372fa175c8 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:20.236547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141dea6-d168-4173-a03e-54f1cbb9ac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:20.236916 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7ed8c-ce47-4f10-b9f1-559891eccc5a None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:20.237781 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141dea6-d168-4173-a03e-54f1cbb9ac61 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:20.238263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141dea6-d168-4173-a03e-54f1cbb9ac61 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:20.238975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141dea6-d168-4173-a03e-54f1cbb9ac61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:20.240875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141dea6-d168-4173-a03e-54f1cbb9ac61 None admin] RBAC: Adding query filter params (group.id=0250f650ee6d4460b749cd96e38971f2, role.id=9487c6d4fd524d9bae767533a1315b15, scope.project.id=68ea978bc82b479ea618aa819bb351fc) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:20.241460 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141dea6-d168-4173-a03e-54f1cbb9ac61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:20.243124 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141dea6-d168-4173-a03e-54f1cbb9ac61 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:20.252210 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 220/426] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Apr 29 20:00:19 2022] GET /identity/v3/role_assignments?group.id=0250f650ee6d4460b749cd96e38971f2&scope.project.id=68ea978bc82b479ea618aa819bb351fc&role.id=9487c6d4fd524d9bae767533a1315b15 => generated 611 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:20.253887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a24bdb-e2c4-457f-98dc-704f3cc5392c None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:20.254382 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a24bdb-e2c4-457f-98dc-704f3cc5392c None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:20.254872 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a24bdb-e2c4-457f-98dc-704f3cc5392c None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:20.261424 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 221/427] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:20.263859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c964a-6bb5-4c2c-b4aa-b0f600aeb5de None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:20.264397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c964a-6bb5-4c2c-b4aa-b0f600aeb5de None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:20.264852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c964a-6bb5-4c2c-b4aa-b0f600aeb5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:20.285595 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-ef5c964a-6bb5-4c2c-b4aa-b0f600aeb5de None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:20.287179 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-ef5c964a-6bb5-4c2c-b4aa-b0f600aeb5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:20.308315 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae623f5-b5c2-4c92-bc0f-1cb9bab4cefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:20.309003 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae623f5-b5c2-4c92-bc0f-1cb9bab4cefc None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:20.309284 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae623f5-b5c2-4c92-bc0f-1cb9bab4cefc None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:20.309558 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae623f5-b5c2-4c92-bc0f-1cb9bab4cefc None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:20.310318 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae623f5-b5c2-4c92-bc0f-1cb9bab4cefc None admin] RBAC: Adding query filter params (name=member) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:20.310625 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae623f5-b5c2-4c92-bc0f-1cb9bab4cefc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:20.313617 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae623f5-b5c2-4c92-bc0f-1cb9bab4cefc None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:20.329126 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 207/428] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 20:00:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:20.336330 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae623f5-b5c2-4c92-bc0f-1cb9bab4cefc None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:20.436713 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 222/429] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:20.467768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c964a-6bb5-4c2c-b4aa-b0f600aeb5de None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:20.524657 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae623f5-b5c2-4c92-bc0f-1cb9bab4cefc None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:20.575256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c964a-6bb5-4c2c-b4aa-b0f600aeb5de None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:20.582474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d1d06-cdfb-4949-bc3f-d594568526ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:20.583426 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d1d06-cdfb-4949-bc3f-d594568526ce None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:20.583936 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d1d06-cdfb-4949-bc3f-d594568526ce None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:20.584464 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d1d06-cdfb-4949-bc3f-d594568526ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:20.619224 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0449dd0-2541-46d4-9eaa-0632237e1718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:20.620223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0449dd0-2541-46d4-9eaa-0632237e1718 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:20.620504 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0449dd0-2541-46d4-9eaa-0632237e1718 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:20.620769 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0449dd0-2541-46d4-9eaa-0632237e1718 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:20.634380 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0449dd0-2541-46d4-9eaa-0632237e1718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-b0449dd0-2541-46d4-9eaa-0632237e1718 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:20.642134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:20.643238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:20.644227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:20.644227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:20.644227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:20.644227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:20.644227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:20.644227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:20.644227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:20.644227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:20.644227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:20.644227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:20.644227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 29 20:00:20.644227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:20.644227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 223/430] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:20.653005 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0449dd0-2541-46d4-9eaa-0632237e1718 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:20.671374 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d1d06-cdfb-4949-bc3f-d594568526ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:20.673786 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d1d06-cdfb-4949-bc3f-d594568526ce None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:20.759553 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0449dd0-2541-46d4-9eaa-0632237e1718 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:20.780353 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 208/431] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:20.781269 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d1d06-cdfb-4949-bc3f-d594568526ce None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:20.794476 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae14e0-1c39-4879-bbcb-fe83a09b1e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:20.795433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae14e0-1c39-4879-bbcb-fe83a09b1e81 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:20.795906 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae14e0-1c39-4879-bbcb-fe83a09b1e81 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:20.796425 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae14e0-1c39-4879-bbcb-fe83a09b1e81 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:20.797371 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae14e0-1c39-4879-bbcb-fe83a09b1e81 None admin] RBAC: Adding query filter params (name=member) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:20.797864 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae14e0-1c39-4879-bbcb-fe83a09b1e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:20.799458 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae14e0-1c39-4879-bbcb-fe83a09b1e81 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:20.808681 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 224/432] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 20:00:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:20.814361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae14e0-1c39-4879-bbcb-fe83a09b1e81 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:20.887458 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d1d06-cdfb-4949-bc3f-d594568526ce None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:20.918324 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae14e0-1c39-4879-bbcb-fe83a09b1e81 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:20.923633 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1ce72-f7b2-40ed-bede-3ce5f6691191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:20.924667 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1ce72-f7b2-40ed-bede-3ce5f6691191 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:20.924955 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1ce72-f7b2-40ed-bede-3ce5f6691191 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:20.925231 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1ce72-f7b2-40ed-bede-3ce5f6691191 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:20.926444 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1ce72-f7b2-40ed-bede-3ce5f6691191 None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:20.927892 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1ce72-f7b2-40ed-bede-3ce5f6691191 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:20.934942 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 209/433] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:20 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:20.935788 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1ce72-f7b2-40ed-bede-3ce5f6691191 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:20.955890 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a75323-0ade-4bcd-bd09-32d817ccf472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:20.956911 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a75323-0ade-4bcd-bd09-32d817ccf472 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:20.957507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a75323-0ade-4bcd-bd09-32d817ccf472 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:20.957976 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a75323-0ade-4bcd-bd09-32d817ccf472 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:21.029305 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a75323-0ade-4bcd-bd09-32d817ccf472 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:21.039368 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a75323-0ade-4bcd-bd09-32d817ccf472 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:21.039544 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1ce72-f7b2-40ed-bede-3ce5f6691191 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:21.074825 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea19c9c-a1cb-4c92-b63e-69c7418d0608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:21.075679 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea19c9c-a1cb-4c92-b63e-69c7418d0608 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:21.075966 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea19c9c-a1cb-4c92-b63e-69c7418d0608 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:21.076264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea19c9c-a1cb-4c92-b63e-69c7418d0608 None admin] PATH_INFO: `/v3/groups/0250f650ee6d4460b749cd96e38971f2` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:21.077505 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea19c9c-a1cb-4c92-b63e-69c7418d0608 None admin] RBAC: Authorizing `identity:get_group(group_id=0250f650ee6d4460b749cd96e38971f2)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:21.079061 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea19c9c-a1cb-4c92-b63e-69c7418d0608 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:21.080789 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 210/434] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Apr 29 20:00:20 2022] GET /identity/v3/groups/0250f650ee6d4460b749cd96e38971f2 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:21.086707 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc1f65-8783-4230-86fe-5c822c845785 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:21.086998 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc1f65-8783-4230-86fe-5c822c845785 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:21.087279 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc1f65-8783-4230-86fe-5c822c845785 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:21.088686 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 211/435] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:21.089243 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc1f65-8783-4230-86fe-5c822c845785 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:21.138829 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 225/436] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:21.138829 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4527c-0503-48e9-bd33-ffee861beec6 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:21.138829 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4527c-0503-48e9-bd33-ffee861beec6 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:21.138829 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4527c-0503-48e9-bd33-ffee861beec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:21.155623 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-a0d4527c-0503-48e9-bd33-ffee861beec6 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:21.156839 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-a0d4527c-0503-48e9-bd33-ffee861beec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:21.202940 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc1f65-8783-4230-86fe-5c822c845785 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:21.224036 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 226/437] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:21.224036 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4527c-0503-48e9-bd33-ffee861beec6 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:21.258519 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1f50d-0d50-4c68-84ab-a7c33901e75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:21.260266 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1f50d-0d50-4c68-84ab-a7c33901e75c None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:21.260770 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1f50d-0d50-4c68-84ab-a7c33901e75c None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:21.261225 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1f50d-0d50-4c68-84ab-a7c33901e75c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:21.262228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1f50d-0d50-4c68-84ab-a7c33901e75c None admin] RBAC: Adding query filter params (group.id=0250f650ee6d4460b749cd96e38971f2, role.id=a2a640f930c44b2fa40f432179d7faa4, scope.project.id=52da462806f246f2bf40478b710ccc94) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:21.262720 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1f50d-0d50-4c68-84ab-a7c33901e75c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:21.264348 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1f50d-0d50-4c68-84ab-a7c33901e75c None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:21.272725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 212/438] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Apr 29 20:00:21 2022] GET /identity/v3/role_assignments?group.id=0250f650ee6d4460b749cd96e38971f2&scope.project.id=52da462806f246f2bf40478b710ccc94&role.id=a2a640f930c44b2fa40f432179d7faa4 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:21.272725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1f50d-0d50-4c68-84ab-a7c33901e75c None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:21.354908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4527c-0503-48e9-bd33-ffee861beec6 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:21.385412 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1f50d-0d50-4c68-84ab-a7c33901e75c None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:21.404716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cf962-9386-4e90-86a4-d339c7ea2b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:21.405585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cf962-9386-4e90-86a4-d339c7ea2b2b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:21.405863 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cf962-9386-4e90-86a4-d339c7ea2b2b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:21.406619 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cf962-9386-4e90-86a4-d339c7ea2b2b None admin] PATH_INFO: `/v3/projects/68ea978bc82b479ea618aa819bb351fc` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:21.408145 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cf962-9386-4e90-86a4-d339c7ea2b2b None admin] RBAC: Authorizing `identity:get_project(project_id=68ea978bc82b479ea618aa819bb351fc)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:21.410215 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cf962-9386-4e90-86a4-d339c7ea2b2b None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:21.412400 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 227/439] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:21 2022] GET /identity/v3/projects/68ea978bc82b479ea618aa819bb351fc => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:21.413779 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217193d-f88c-4719-b322-1d515a7ca267 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:21.414059 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217193d-f88c-4719-b322-1d515a7ca267 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:21.414393 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217193d-f88c-4719-b322-1d515a7ca267 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:21.415969 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 228/440] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:21.419527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217193d-f88c-4719-b322-1d515a7ca267 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:21.423645 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c561dfe-cdf9-4bdc-869d-785cdfcc1dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:21.424502 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c561dfe-cdf9-4bdc-869d-785cdfcc1dc1 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:21.424770 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c561dfe-cdf9-4bdc-869d-785cdfcc1dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:21.425028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c561dfe-cdf9-4bdc-869d-785cdfcc1dc1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:21.436399 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c561dfe-cdf9-4bdc-869d-785cdfcc1dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-5c561dfe-cdf9-4bdc-869d-785cdfcc1dc1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:21.445239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:21.446221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:21.447086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:21.447086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:21.447086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:21.447086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:21.447086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:21.447086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:21.447086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:21.447086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:21.447086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:21.447086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:21.447086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 29 20:00:21.447086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:21.447086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 213/441] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 20:00:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:21.447753 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a8f9c-d311-4f45-823e-316db836b6b4 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:21.453391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a8f9c-d311-4f45-823e-316db836b6b4 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:21.453391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a8f9c-d311-4f45-823e-316db836b6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:21.466732 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-d70a8f9c-d311-4f45-823e-316db836b6b4 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:21.467926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-d70a8f9c-d311-4f45-823e-316db836b6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:21.534951 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217193d-f88c-4719-b322-1d515a7ca267 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:21.543656 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 214/442] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:21.544548 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a8f9c-d311-4f45-823e-316db836b6b4 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:21.582044 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abc26f-6317-423a-b752-23f3c86b05d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:21.583029 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abc26f-6317-423a-b752-23f3c86b05d9 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:21.583395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abc26f-6317-423a-b752-23f3c86b05d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:21.583727 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abc26f-6317-423a-b752-23f3c86b05d9 None admin] PATH_INFO: `/v3/groups/0250f650ee6d4460b749cd96e38971f2` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:21.585035 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abc26f-6317-423a-b752-23f3c86b05d9 None admin] RBAC: Authorizing `identity:get_group(group_id=0250f650ee6d4460b749cd96e38971f2)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:21.586557 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abc26f-6317-423a-b752-23f3c86b05d9 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:21.589391 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 229/443] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Apr 29 20:00:21 2022] GET /identity/v3/groups/0250f650ee6d4460b749cd96e38971f2 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:21.591001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abc26f-6317-423a-b752-23f3c86b05d9 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:21.661482 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a8f9c-d311-4f45-823e-316db836b6b4 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:21.696664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28d24e-4e4a-4a5a-a0d3-eb75e2ffcaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:21.697321 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28d24e-4e4a-4a5a-a0d3-eb75e2ffcaa5 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:21.697596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28d24e-4e4a-4a5a-a0d3-eb75e2ffcaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:21.697862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28d24e-4e4a-4a5a-a0d3-eb75e2ffcaa5 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:21.698595 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28d24e-4e4a-4a5a-a0d3-eb75e2ffcaa5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:21.698891 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28d24e-4e4a-4a5a-a0d3-eb75e2ffcaa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:21.700277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28d24e-4e4a-4a5a-a0d3-eb75e2ffcaa5 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:21.703534 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abc26f-6317-423a-b752-23f3c86b05d9 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:21.707751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 215/444] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:21.708553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28d24e-4e4a-4a5a-a0d3-eb75e2ffcaa5 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:21.737750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc704ebf-50e6-48cc-8add-0ec10e6f1f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:21.738554 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc704ebf-50e6-48cc-8add-0ec10e6f1f17 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:21.738816 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc704ebf-50e6-48cc-8add-0ec10e6f1f17 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:21.739085 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc704ebf-50e6-48cc-8add-0ec10e6f1f17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:21.749195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc704ebf-50e6-48cc-8add-0ec10e6f1f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-dc704ebf-50e6-48cc-8add-0ec10e6f1f17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:21.757507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:21.758459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:21.759263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:21.759263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:21.759263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:21.759263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:21.759263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:21.759263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:21.759263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:21.759263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:21.759263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:21.759263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:21.759263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:00:21.759263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:21.763429 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 230/445] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 20:00:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:21.764149 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc704ebf-50e6-48cc-8add-0ec10e6f1f17 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:21.801320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28d24e-4e4a-4a5a-a0d3-eb75e2ffcaa5 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:21.832999 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da5bb7-ad9e-44f8-96f8-d7f65f344d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:21.833633 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da5bb7-ad9e-44f8-96f8-d7f65f344d68 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:21.833918 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da5bb7-ad9e-44f8-96f8-d7f65f344d68 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:21.834184 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da5bb7-ad9e-44f8-96f8-d7f65f344d68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:21.835021 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da5bb7-ad9e-44f8-96f8-d7f65f344d68 None admin] RBAC: Adding query filter params (group.id=0250f650ee6d4460b749cd96e38971f2, role.id=a2a640f930c44b2fa40f432179d7faa4, scope.project.id=68ea978bc82b479ea618aa819bb351fc) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:21.835325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da5bb7-ad9e-44f8-96f8-d7f65f344d68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:21.836782 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da5bb7-ad9e-44f8-96f8-d7f65f344d68 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:21.842431 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 216/446] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Apr 29 20:00:21 2022] GET /identity/v3/role_assignments?group.id=0250f650ee6d4460b749cd96e38971f2&scope.project.id=68ea978bc82b479ea618aa819bb351fc&role.id=a2a640f930c44b2fa40f432179d7faa4 => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:21.843107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da5bb7-ad9e-44f8-96f8-d7f65f344d68 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:21.860142 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc704ebf-50e6-48cc-8add-0ec10e6f1f17 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:21.897215 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef54746-2675-484b-a209-89e44fb0eaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:21.898528 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef54746-2675-484b-a209-89e44fb0eaa2 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:21.898806 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef54746-2675-484b-a209-89e44fb0eaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:21.899076 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef54746-2675-484b-a209-89e44fb0eaa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:21.952326 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da5bb7-ad9e-44f8-96f8-d7f65f344d68 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:21.971880 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef54746-2675-484b-a209-89e44fb0eaa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:21.973859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef54746-2675-484b-a209-89e44fb0eaa2 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:22.000620 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2e595-8f4c-40e5-8a6e-95ca5ca7c03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:22.001593 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2e595-8f4c-40e5-8a6e-95ca5ca7c03e None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:22.002015 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2e595-8f4c-40e5-8a6e-95ca5ca7c03e None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:22.002426 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2e595-8f4c-40e5-8a6e-95ca5ca7c03e None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:22.003609 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2e595-8f4c-40e5-8a6e-95ca5ca7c03e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:22.004105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2e595-8f4c-40e5-8a6e-95ca5ca7c03e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:22.006321 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2e595-8f4c-40e5-8a6e-95ca5ca7c03e None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:22.024444 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 217/447] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:22.025970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2e595-8f4c-40e5-8a6e-95ca5ca7c03e None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:22.089432 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 231/448] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:22.095414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef54746-2675-484b-a209-89e44fb0eaa2 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:22.135444 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2e595-8f4c-40e5-8a6e-95ca5ca7c03e None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:22.167704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe9893-2241-4d1b-93f3-92218e13374c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:22.168367 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe9893-2241-4d1b-93f3-92218e13374c None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:22.168647 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe9893-2241-4d1b-93f3-92218e13374c None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:22.168919 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe9893-2241-4d1b-93f3-92218e13374c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:22.187747 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef54746-2675-484b-a209-89e44fb0eaa2 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:22.220474 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4a27d-c024-4377-9874-efbc516ad072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:22.221257 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4a27d-c024-4377-9874-efbc516ad072 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:22.221536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4a27d-c024-4377-9874-efbc516ad072 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:22.221823 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4a27d-c024-4377-9874-efbc516ad072 None admin] PATH_INFO: `/v3/projects/52da462806f246f2bf40478b710ccc94` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:22.222971 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4a27d-c024-4377-9874-efbc516ad072 None admin] RBAC: Authorizing `identity:get_project(project_id=52da462806f246f2bf40478b710ccc94)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:22.224455 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4a27d-c024-4377-9874-efbc516ad072 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:22.226668 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 232/449] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:22 2022] GET /identity/v3/projects/52da462806f246f2bf40478b710ccc94 => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:22.230541 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe9893-2241-4d1b-93f3-92218e13374c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:22.231969 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe9893-2241-4d1b-93f3-92218e13374c None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:22.232318 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4a27d-c024-4377-9874-efbc516ad072 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:22.323958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 218/450] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:22.324978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4a27d-c024-4377-9874-efbc516ad072 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:22.329560 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe9893-2241-4d1b-93f3-92218e13374c None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:22.360603 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e994b-d043-4871-ab79-f75651d436be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:22.361462 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e994b-d043-4871-ab79-f75651d436be None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:22.361735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e994b-d043-4871-ab79-f75651d436be None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:22.362010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e994b-d043-4871-ab79-f75651d436be None admin] PATH_INFO: `/v3/groups/0250f650ee6d4460b749cd96e38971f2` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:22.363199 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e994b-d043-4871-ab79-f75651d436be None admin] RBAC: Authorizing `identity:get_group(group_id=0250f650ee6d4460b749cd96e38971f2)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:22.364678 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e994b-d043-4871-ab79-f75651d436be None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:22.373286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 233/451] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Apr 29 20:00:22 2022] GET /identity/v3/groups/0250f650ee6d4460b749cd96e38971f2 => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:22.374632 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e994b-d043-4871-ab79-f75651d436be None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:22.425601 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe9893-2241-4d1b-93f3-92218e13374c None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:22.457622 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8c1ac-fa91-4e49-bcad-3e9e5063525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:22.458470 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8c1ac-fa91-4e49-bcad-3e9e5063525b None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:22.458753 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8c1ac-fa91-4e49-bcad-3e9e5063525b None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:22.459035 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8c1ac-fa91-4e49-bcad-3e9e5063525b None admin] PATH_INFO: `/v3/projects/1e417b1278554b3d876c18d3b8c537fa` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:22.460265 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8c1ac-fa91-4e49-bcad-3e9e5063525b None admin] RBAC: Authorizing `identity:get_project(project_id=1e417b1278554b3d876c18d3b8c537fa)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:22.461703 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8c1ac-fa91-4e49-bcad-3e9e5063525b None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:22.463383 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 219/452] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Apr 29 20:00:22 2022] GET /identity/v3/projects/1e417b1278554b3d876c18d3b8c537fa => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:22.468726 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8c1ac-fa91-4e49-bcad-3e9e5063525b None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:22.469132 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e994b-d043-4871-ab79-f75651d436be None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:22.501306 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3a2cb-439a-45c1-b354-4f455d8795f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:22.501887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3a2cb-439a-45c1-b354-4f455d8795f4 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:22.502167 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3a2cb-439a-45c1-b354-4f455d8795f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:22.502438 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3a2cb-439a-45c1-b354-4f455d8795f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:22.503254 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3a2cb-439a-45c1-b354-4f455d8795f4 None admin] RBAC: Adding query filter params (group.id=0250f650ee6d4460b749cd96e38971f2, role.id=9487c6d4fd524d9bae767533a1315b15, scope.project.id=52da462806f246f2bf40478b710ccc94) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:22.503559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3a2cb-439a-45c1-b354-4f455d8795f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:22.505006 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3a2cb-439a-45c1-b354-4f455d8795f4 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:22.511164 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 234/453] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Apr 29 20:00:22 2022] GET /identity/v3/role_assignments?group.id=0250f650ee6d4460b749cd96e38971f2&scope.project.id=52da462806f246f2bf40478b710ccc94&role.id=9487c6d4fd524d9bae767533a1315b15 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:22.565452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8c1ac-fa91-4e49-bcad-3e9e5063525b None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:22.599908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d80a41-e01f-4038-b2a4-58b7460d1e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:22.601480 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80a41-e01f-4038-b2a4-58b7460d1e6f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:22.601756 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80a41-e01f-4038-b2a4-58b7460d1e6f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:22.602027 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80a41-e01f-4038-b2a4-58b7460d1e6f None admin] PATH_INFO: `/v3/groups/d53754eeaaf1483486207e0978bb04ef` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:22.603266 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d80a41-e01f-4038-b2a4-58b7460d1e6f None admin] RBAC: Authorizing `identity:get_group(group_id=d53754eeaaf1483486207e0978bb04ef)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:22.605031 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d80a41-e01f-4038-b2a4-58b7460d1e6f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:22.606747 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 220/454] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Apr 29 20:00:22 2022] GET /identity/v3/groups/d53754eeaaf1483486207e0978bb04ef => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:22.612777 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3a2cb-439a-45c1-b354-4f455d8795f4 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:22.713012 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3a2cb-439a-45c1-b354-4f455d8795f4 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:22.746781 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4a539-ec88-41d8-b6b3-ca11d8c73ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:22.747429 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4a539-ec88-41d8-b6b3-ca11d8c73ac5 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:22.747712 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4a539-ec88-41d8-b6b3-ca11d8c73ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:22.748058 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4a539-ec88-41d8-b6b3-ca11d8c73ac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:22.748870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4a539-ec88-41d8-b6b3-ca11d8c73ac5 None admin] RBAC: Adding query filter params (group.id=d53754eeaaf1483486207e0978bb04ef, role.id=5255ed3fa613448fb4c549f5bc7f20af, scope.project.id=1e417b1278554b3d876c18d3b8c537fa) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:22.749174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4a539-ec88-41d8-b6b3-ca11d8c73ac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:22.750588 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4a539-ec88-41d8-b6b3-ca11d8c73ac5 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:22.756392 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 235/455] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Apr 29 20:00:22 2022] GET /identity/v3/role_assignments?group.id=d53754eeaaf1483486207e0978bb04ef&scope.project.id=1e417b1278554b3d876c18d3b8c537fa&role.id=5255ed3fa613448fb4c549f5bc7f20af => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:25.549551 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c57c2-2a40-4c14-a80f-e13f99ac1678 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:25.550089 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c57c2-2a40-4c14-a80f-e13f99ac1678 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:25.550089 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c57c2-2a40-4c14-a80f-e13f99ac1678 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:25.551666 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 221/456] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:25.557712 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2474a-b3df-408f-8133-059477a3eef8 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:25.558583 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2474a-b3df-408f-8133-059477a3eef8 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:25.559059 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2474a-b3df-408f-8133-059477a3eef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:25.577778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-87a2474a-b3df-408f-8133-059477a3eef8 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:25.579251 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-87a2474a-b3df-408f-8133-059477a3eef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:25.649965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 236/457] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:25.676140 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c57c2-2a40-4c14-a80f-e13f99ac1678 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:25.700324 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01692e9-e0fb-4b5e-bc0b-408e790df9b1 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:25.700963 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01692e9-e0fb-4b5e-bc0b-408e790df9b1 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:25.701438 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01692e9-e0fb-4b5e-bc0b-408e790df9b1 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:25.702981 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 237/458] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:00:25.708159 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080e55d-f531-4fa1-8f5a-c023b8256e21 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:25.708698 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080e55d-f531-4fa1-8f5a-c023b8256e21 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:25.709184 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080e55d-f531-4fa1-8f5a-c023b8256e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:25.726999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-7080e55d-f531-4fa1-8f5a-c023b8256e21 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:25.729248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-7080e55d-f531-4fa1-8f5a-c023b8256e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:25.784525 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c57c2-2a40-4c14-a80f-e13f99ac1678 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:25.819029 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba72800-1bd1-4d50-83bf-b777f0200ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:25.820664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72800-1bd1-4d50-83bf-b777f0200ae3 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:25.821159 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72800-1bd1-4d50-83bf-b777f0200ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:25.821630 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72800-1bd1-4d50-83bf-b777f0200ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:25.824052 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 238/459] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:25.831770 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ec2d-75b5-4e8b-b3fe-8e9b5a2977e5 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:25.832298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ec2d-75b5-4e8b-b3fe-8e9b5a2977e5 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:25.832738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ec2d-75b5-4e8b-b3fe-8e9b5a2977e5 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:25.837780 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba72800-1bd1-4d50-83bf-b777f0200ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:25.838461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 239/460] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:25.839880 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba72800-1bd1-4d50-83bf-b777f0200ae3 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:25.840111 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda21bd-5c9b-426a-892a-bbd819432e6a None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:25.840268 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda21bd-5c9b-426a-892a-bbd819432e6a None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:25.840548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda21bd-5c9b-426a-892a-bbd819432e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:25.857308 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-cdda21bd-5c9b-426a-892a-bbd819432e6a None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:25.858476 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-cdda21bd-5c9b-426a-892a-bbd819432e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:25.859420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-7ba72800-1bd1-4d50-83bf-b777f0200ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:25.859420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:25.859420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:25.859420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:25.859420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:25.859420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:25.859420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:25.859420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:25.859420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:25.859420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:25.859420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:25.859420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:25.859420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:25.859420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:25.859420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:25.860466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:25.861324 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:25.861324 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:25.861324 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:25.861324 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:25.863442 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 222/461] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:25.864514 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba72800-1bd1-4d50-83bf-b777f0200ae3 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:25.931285 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 240/462] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 20:00:25.931898 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda21bd-5c9b-426a-892a-bbd819432e6a None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:25.971772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba72800-1bd1-4d50-83bf-b777f0200ae3 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:26.004948 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae46635-467b-4f16-beb5-2d40490091bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:26.005740 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae46635-467b-4f16-beb5-2d40490091bd None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:26.006017 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae46635-467b-4f16-beb5-2d40490091bd None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:26.006292 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae46635-467b-4f16-beb5-2d40490091bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:26.016715 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae46635-467b-4f16-beb5-2d40490091bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:26.018207 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae46635-467b-4f16-beb5-2d40490091bd None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:26.030278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda21bd-5c9b-426a-892a-bbd819432e6a None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:26.035605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-6ae46635-467b-4f16-beb5-2d40490091bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:26.035605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:26.035605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:26.035605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:26.035605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:26.035605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:26.035605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:26.035605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:26.035605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:26.035605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:26.035605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:26.035605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:26.035605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:26.035605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:26.035605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:26.036641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:26.037491 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:26.037491 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:26.037491 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:26.037491 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:26.037491 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 223/463] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:26.037749 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae46635-467b-4f16-beb5-2d40490091bd None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:26.067557 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd865f-7bc4-4177-a429-5d8e00e8cb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:26.068246 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd865f-7bc4-4177-a429-5d8e00e8cb74 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:26.068528 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd865f-7bc4-4177-a429-5d8e00e8cb74 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:26.068807 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd865f-7bc4-4177-a429-5d8e00e8cb74 None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:26.069548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd865f-7bc4-4177-a429-5d8e00e8cb74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:26.069859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd865f-7bc4-4177-a429-5d8e00e8cb74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:26.071237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd865f-7bc4-4177-a429-5d8e00e8cb74 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:26.088684 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 241/464] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:26.089582 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd865f-7bc4-4177-a429-5d8e00e8cb74 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:26.138881 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae46635-467b-4f16-beb5-2d40490091bd None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:26.170177 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d385a73-9a27-466e-83cc-488742a3b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:26.170957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d385a73-9a27-466e-83cc-488742a3b9bb None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:26.171245 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d385a73-9a27-466e-83cc-488742a3b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:26.171517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d385a73-9a27-466e-83cc-488742a3b9bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:26.182325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d385a73-9a27-466e-83cc-488742a3b9bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:26.182909 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd865f-7bc4-4177-a429-5d8e00e8cb74 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:26.183739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d385a73-9a27-466e-83cc-488742a3b9bb None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:26.200664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-6d385a73-9a27-466e-83cc-488742a3b9bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:26.200664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:26.200664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:26.200664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:26.200664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:26.200664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:26.200664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:26.200664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:26.200664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:26.200664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:26.200664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:26.200664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:26.200664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:26.200664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:26.200664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:26.201524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:26.202383 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:26.202383 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:26.202383 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:26.202383 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:26.202383 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 224/465] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:26.202997 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bfd03-2e28-4b98-9856-00317dc08a56 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:26.203276 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bfd03-2e28-4b98-9856-00317dc08a56 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:26.203548 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bfd03-2e28-4b98-9856-00317dc08a56 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:26.205167 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 225/466] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:26.206105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bfd03-2e28-4b98-9856-00317dc08a56 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:26.217728 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff0561-5011-4d64-a411-85358513f219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:26.218380 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff0561-5011-4d64-a411-85358513f219 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:26.218653 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff0561-5011-4d64-a411-85358513f219 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:26.218921 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff0561-5011-4d64-a411-85358513f219 None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:26.219626 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff0561-5011-4d64-a411-85358513f219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:26.219928 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff0561-5011-4d64-a411-85358513f219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:26.221327 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff0561-5011-4d64-a411-85358513f219 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:26.232823 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 242/467] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:26.233586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff0561-5011-4d64-a411-85358513f219 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:26.302704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bfd03-2e28-4b98-9856-00317dc08a56 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:26.326691 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff0561-5011-4d64-a411-85358513f219 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:26.335847 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994ee1c-e068-4dc8-8eed-9041cd2796c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:26.336612 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994ee1c-e068-4dc8-8eed-9041cd2796c3 None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:26.336891 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994ee1c-e068-4dc8-8eed-9041cd2796c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:26.337161 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994ee1c-e068-4dc8-8eed-9041cd2796c3 None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:26.337845 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994ee1c-e068-4dc8-8eed-9041cd2796c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:26.339275 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994ee1c-e068-4dc8-8eed-9041cd2796c3 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:26.359916 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b2388-bca9-4e4e-a37e-761a253c55dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:26.360608 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b2388-bca9-4e4e-a37e-761a253c55dd None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:26.360886 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b2388-bca9-4e4e-a37e-761a253c55dd None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:26.361155 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b2388-bca9-4e4e-a37e-761a253c55dd None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:26.361874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b2388-bca9-4e4e-a37e-761a253c55dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:26.362171 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b2388-bca9-4e4e-a37e-761a253c55dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:26.363546 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b2388-bca9-4e4e-a37e-761a253c55dd None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:26.374428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 243/468] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:26.375738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344c8e2-451d-49bc-bb55-7259b1d138ca None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:26.376059 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344c8e2-451d-49bc-bb55-7259b1d138ca None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:26.376341 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344c8e2-451d-49bc-bb55-7259b1d138ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:26.392360 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-f344c8e2-451d-49bc-bb55-7259b1d138ca None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:26.393569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-f344c8e2-451d-49bc-bb55-7259b1d138ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:26.456858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 244/469] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:26.457600 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344c8e2-451d-49bc-bb55-7259b1d138ca None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:26.491491 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 226/470] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Apr 29 20:00:26 2022] POST /identity/v3/users => generated 246 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:00:26.492333 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994ee1c-e068-4dc8-8eed-9041cd2796c3 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:26.560542 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344c8e2-451d-49bc-bb55-7259b1d138ca None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:26.600229 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994ee1c-e068-4dc8-8eed-9041cd2796c3 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:26.600780 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35870b61-0ecf-422b-8946-f0ff1f477b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:26.601046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35870b61-0ecf-422b-8946-f0ff1f477b03 None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:26.601227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35870b61-0ecf-422b-8946-f0ff1f477b03 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:26.601494 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35870b61-0ecf-422b-8946-f0ff1f477b03 None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:26.602265 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35870b61-0ecf-422b-8946-f0ff1f477b03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:26.604173 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35870b61-0ecf-422b-8946-f0ff1f477b03 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:26.636558 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d22dc9-240f-49d0-b447-1e4985df4843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:26.637234 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d22dc9-240f-49d0-b447-1e4985df4843 None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:26.637512 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d22dc9-240f-49d0-b447-1e4985df4843 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:26.637783 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d22dc9-240f-49d0-b447-1e4985df4843 None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:26.638481 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d22dc9-240f-49d0-b447-1e4985df4843 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:26.639925 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d22dc9-240f-49d0-b447-1e4985df4843 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:26.680837 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 245/471] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Apr 29 20:00:26 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:00:26.681666 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35870b61-0ecf-422b-8946-f0ff1f477b03 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:26.746372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 227/472] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Apr 29 20:00:26 2022] POST /identity/v3/users => generated 248 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:00:26.807912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35870b61-0ecf-422b-8946-f0ff1f477b03 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:26.848881 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20c3df-13f6-4929-b9f5-a2c5e8310db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:26.849708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20c3df-13f6-4929-b9f5-a2c5e8310db0 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:26.849989 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20c3df-13f6-4929-b9f5-a2c5e8310db0 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:26.850263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20c3df-13f6-4929-b9f5-a2c5e8310db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:26.863361 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20c3df-13f6-4929-b9f5-a2c5e8310db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:26.864904 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20c3df-13f6-4929-b9f5-a2c5e8310db0 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:26.885953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-2a20c3df-13f6-4929-b9f5-a2c5e8310db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:26.885953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:26.885953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:26.885953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:26.885953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:26.885953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:26.885953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:26.885953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:26.885953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:26.885953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:26.885953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:26.885953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:26.885953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:26.885953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:26.885953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:26.886874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:26.888240 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:26.888240 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:26.888240 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:26.888240 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:26.888240 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 246/473] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:26.893594 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d22dc9-240f-49d0-b447-1e4985df4843 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:27.014715 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d22dc9-240f-49d0-b447-1e4985df4843 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:27.057663 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f950d-a2a3-40ca-a8b5-24f8c19b2bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:27.058323 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f950d-a2a3-40ca-a8b5-24f8c19b2bfe None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:27.058600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f950d-a2a3-40ca-a8b5-24f8c19b2bfe None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:27.058870 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f950d-a2a3-40ca-a8b5-24f8c19b2bfe None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:27.059614 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f950d-a2a3-40ca-a8b5-24f8c19b2bfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:27.060080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f950d-a2a3-40ca-a8b5-24f8c19b2bfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:27.062217 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f950d-a2a3-40ca-a8b5-24f8c19b2bfe None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:27.078438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 228/474] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:27.083633 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20c3df-13f6-4929-b9f5-a2c5e8310db0 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:27.183918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20c3df-13f6-4929-b9f5-a2c5e8310db0 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:27.217082 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9be3e-5546-4132-9116-33e67e1305c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:27.218088 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9be3e-5546-4132-9116-33e67e1305c1 None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:27.218567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9be3e-5546-4132-9116-33e67e1305c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:27.219152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9be3e-5546-4132-9116-33e67e1305c1 None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:27.220100 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9be3e-5546-4132-9116-33e67e1305c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:27.221741 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9be3e-5546-4132-9116-33e67e1305c1 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:27.306711 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 247/475] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Apr 29 20:00:27 2022] POST /identity/v3/users => generated 249 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:00:28.936050 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f586f-74a2-43d2-9047-374af262e8d8 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:28.936556 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f586f-74a2-43d2-9047-374af262e8d8 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:28.936632 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f586f-74a2-43d2-9047-374af262e8d8 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:28.938261 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 229/476] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:28.943707 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ec9f7-183d-437c-8a4c-52ed831af00f None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:28.944262 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ec9f7-183d-437c-8a4c-52ed831af00f None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:28.944885 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ec9f7-183d-437c-8a4c-52ed831af00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:28.962833 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-776ec9f7-183d-437c-8a4c-52ed831af00f None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:28.964124 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-776ec9f7-183d-437c-8a4c-52ed831af00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:29.044126 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 248/477] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:29.063634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f586f-74a2-43d2-9047-374af262e8d8 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:29.170726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dddff-52f9-470c-9e81-f085961d7b89 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:29.171365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dddff-52f9-470c-9e81-f085961d7b89 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:29.171841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dddff-52f9-470c-9e81-f085961d7b89 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:29.173691 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 249/478] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:29.179998 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f586f-74a2-43d2-9047-374af262e8d8 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:29.183997 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379dc1-e681-49e2-bfe0-8155ab3d4383 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:29.183997 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379dc1-e681-49e2-bfe0-8155ab3d4383 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:29.183997 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379dc1-e681-49e2-bfe0-8155ab3d4383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:29.197923 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-e7379dc1-e681-49e2-bfe0-8155ab3d4383 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:29.199019 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-e7379dc1-e681-49e2-bfe0-8155ab3d4383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:29.217277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80bc326-7ed0-43ae-92e2-b2a1184d1cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:29.218149 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bc326-7ed0-43ae-92e2-b2a1184d1cba None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:29.218448 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bc326-7ed0-43ae-92e2-b2a1184d1cba None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:29.218720 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80bc326-7ed0-43ae-92e2-b2a1184d1cba None admin] PATH_INFO: `/v3/roles/service` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:29.229561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80bc326-7ed0-43ae-92e2-b2a1184d1cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-d80bc326-7ed0-43ae-92e2-b2a1184d1cba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:29.237342 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:29.244684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:29.245680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:29.245680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:29.245680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:29.245680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:29.245680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:29.245680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:29.245680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:29.245680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:29.245680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:29.245680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:29.245680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:29.245680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:29.245680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 230/479] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:29.245680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c2434-4d7d-4162-9c7e-c7c91a2f5083 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:29.246453 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c2434-4d7d-4162-9c7e-c7c91a2f5083 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:29.246453 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c2434-4d7d-4162-9c7e-c7c91a2f5083 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:29.246453 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 231/480] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:29.247108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c2434-4d7d-4162-9c7e-c7c91a2f5083 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:29.275145 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 250/481] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:29.276675 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7560367-d104-4aab-8dfb-d0be180c185b None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:29.276962 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7560367-d104-4aab-8dfb-d0be180c185b None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:29.277236 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7560367-d104-4aab-8dfb-d0be180c185b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:29.295484 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-d7560367-d104-4aab-8dfb-d0be180c185b None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:29.296693 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-d7560367-d104-4aab-8dfb-d0be180c185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:29.363763 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 251/482] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:29.364857 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7560367-d104-4aab-8dfb-d0be180c185b None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:29.385785 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c2434-4d7d-4162-9c7e-c7c91a2f5083 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:29.421104 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe90bd-2199-48e8-bf3c-05b0eb63fa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:29.421770 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe90bd-2199-48e8-bf3c-05b0eb63fa02 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:29.422120 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe90bd-2199-48e8-bf3c-05b0eb63fa02 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:29.422402 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe90bd-2199-48e8-bf3c-05b0eb63fa02 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:29.423144 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe90bd-2199-48e8-bf3c-05b0eb63fa02 None admin] RBAC: Adding query filter params (name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:29.423453 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe90bd-2199-48e8-bf3c-05b0eb63fa02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:29.424860 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe90bd-2199-48e8-bf3c-05b0eb63fa02 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:29.432703 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 232/483] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Apr 29 20:00:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:29.437932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe90bd-2199-48e8-bf3c-05b0eb63fa02 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:29.464765 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7560367-d104-4aab-8dfb-d0be180c185b None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:29.500839 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599a73a-ae32-45b9-b98e-b33e4abd68fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:29.501631 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599a73a-ae32-45b9-b98e-b33e4abd68fa None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:29.501909 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599a73a-ae32-45b9-b98e-b33e4abd68fa None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:29.502181 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599a73a-ae32-45b9-b98e-b33e4abd68fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:29.513895 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599a73a-ae32-45b9-b98e-b33e4abd68fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-f599a73a-ae32-45b9-b98e-b33e4abd68fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:29.521638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:29.523127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:29.524405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:29.524405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:29.524405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:29.524405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:29.524405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:29.524405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:29.524405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:29.524405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:29.524405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:29.524405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:29.524405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:29.524405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:29.524405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 252/484] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:29.524405 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599a73a-ae32-45b9-b98e-b33e4abd68fa None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:29.540003 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe90bd-2199-48e8-bf3c-05b0eb63fa02 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:29.574678 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ff6d9-6458-484c-a5ed-e3f6bba4b801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:29.575490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ff6d9-6458-484c-a5ed-e3f6bba4b801 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:29.576007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ff6d9-6458-484c-a5ed-e3f6bba4b801 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:29.576180 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ff6d9-6458-484c-a5ed-e3f6bba4b801 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:29.588348 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ff6d9-6458-484c-a5ed-e3f6bba4b801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-959ff6d9-6458-484c-a5ed-e3f6bba4b801 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:29.596288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:29.597204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:29.598005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:29.598005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:29.598005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:29.598005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:29.598005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:29.598005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:29.598005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:29.598005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:29.598005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:29.598005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:29.598005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:29.598005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:29.598005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 233/485] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:29.598655 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ff6d9-6458-484c-a5ed-e3f6bba4b801 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:29.632438 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599a73a-ae32-45b9-b98e-b33e4abd68fa None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:29.664376 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d363efa-2bb4-4659-9c61-741f606e9525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:29.665164 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d363efa-2bb4-4659-9c61-741f606e9525 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:29.665443 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d363efa-2bb4-4659-9c61-741f606e9525 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:29.665708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d363efa-2bb4-4659-9c61-741f606e9525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:29.676042 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d363efa-2bb4-4659-9c61-741f606e9525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:29.677790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d363efa-2bb4-4659-9c61-741f606e9525 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:29.696279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-6d363efa-2bb4-4659-9c61-741f606e9525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:29.696279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:29.696279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:29.696279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:29.696279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:29.696279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:29.696279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:29.696279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:29.696279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:29.696279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:29.696279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:29.696279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:29.696279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:29.696279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:29.696279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:29.697328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:29.698381 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:29.698381 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:29.698381 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:29.698381 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:29.703528 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 253/486] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:29.704436 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d363efa-2bb4-4659-9c61-741f606e9525 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:29.705330 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ff6d9-6458-484c-a5ed-e3f6bba4b801 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:29.740331 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e478f1-2a3b-42ea-a279-e106b2531287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:29.741748 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e478f1-2a3b-42ea-a279-e106b2531287 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:29.742175 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e478f1-2a3b-42ea-a279-e106b2531287 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:29.742593 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e478f1-2a3b-42ea-a279-e106b2531287 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:29.743926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e478f1-2a3b-42ea-a279-e106b2531287 None admin] RBAC: Adding query filter params (name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:29.744421 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e478f1-2a3b-42ea-a279-e106b2531287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:29.746651 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e478f1-2a3b-42ea-a279-e106b2531287 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:29.755002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 234/487] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Apr 29 20:00:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:29.755949 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e478f1-2a3b-42ea-a279-e106b2531287 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:29.799651 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d363efa-2bb4-4659-9c61-741f606e9525 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:29.831434 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa16d64-e80f-430d-b65e-975aabbd4bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:29.832127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa16d64-e80f-430d-b65e-975aabbd4bc5 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:29.832402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa16d64-e80f-430d-b65e-975aabbd4bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:29.832676 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa16d64-e80f-430d-b65e-975aabbd4bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:29.833402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa16d64-e80f-430d-b65e-975aabbd4bc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:29.833705 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa16d64-e80f-430d-b65e-975aabbd4bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:29.835100 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa16d64-e80f-430d-b65e-975aabbd4bc5 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:29.842590 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 254/488] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Apr 29 20:00:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:29.843896 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79833358-29e0-4788-83e6-80bbe2d14351 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:29.844210 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79833358-29e0-4788-83e6-80bbe2d14351 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:29.844485 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79833358-29e0-4788-83e6-80bbe2d14351 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:29.845821 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 255/489] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:29.848765 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79833358-29e0-4788-83e6-80bbe2d14351 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:29.849043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e478f1-2a3b-42ea-a279-e106b2531287 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:29.881371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23804771-3560-445e-978a-f81dd59ce93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:29.882580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23804771-3560-445e-978a-f81dd59ce93e None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:29.882854 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23804771-3560-445e-978a-f81dd59ce93e None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:29.883143 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23804771-3560-445e-978a-f81dd59ce93e None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:29.883843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23804771-3560-445e-978a-f81dd59ce93e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:29.884240 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23804771-3560-445e-978a-f81dd59ce93e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:29.885644 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23804771-3560-445e-978a-f81dd59ce93e None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:29.896842 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 235/490] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:29.897655 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23804771-3560-445e-978a-f81dd59ce93e None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:29.946625 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79833358-29e0-4788-83e6-80bbe2d14351 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:29.977433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884a7d5-35d4-4655-b21d-7be2cf2829b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:29.978255 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884a7d5-35d4-4655-b21d-7be2cf2829b1 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:29.978533 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884a7d5-35d4-4655-b21d-7be2cf2829b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:29.979063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884a7d5-35d4-4655-b21d-7be2cf2829b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:29.987714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23804771-3560-445e-978a-f81dd59ce93e None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:29.990460 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884a7d5-35d4-4655-b21d-7be2cf2829b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:29.990666 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884a7d5-35d4-4655-b21d-7be2cf2829b1 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:30.008258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-1884a7d5-35d4-4655-b21d-7be2cf2829b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:30.008258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:30.008258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:30.008258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:30.008258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:30.008258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:30.008258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:30.008258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:30.008258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:30.008258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:30.008258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:30.008258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:30.008258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:30.008258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:30.008258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:30.009170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:30.010001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:30.010001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:30.010001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:30.010001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:30.010001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 256/491] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:30.010598 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f8391-b0ee-4ca8-ab5e-1cfa0ea0cf77 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:30.010882 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f8391-b0ee-4ca8-ab5e-1cfa0ea0cf77 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:30.011157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f8391-b0ee-4ca8-ab5e-1cfa0ea0cf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:30.021300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8345e-4695-4de8-85d0-01a50eb78095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:30.031286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8345e-4695-4de8-85d0-01a50eb78095 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:30.031286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8345e-4695-4de8-85d0-01a50eb78095 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:30.031286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8345e-4695-4de8-85d0-01a50eb78095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:30.031543 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-5e8f8391-b0ee-4ca8-ab5e-1cfa0ea0cf77 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:30.031543 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-5e8f8391-b0ee-4ca8-ab5e-1cfa0ea0cf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:30.032579 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8345e-4695-4de8-85d0-01a50eb78095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:30.034022 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8345e-4695-4de8-85d0-01a50eb78095 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:30.051520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-05b8345e-4695-4de8-85d0-01a50eb78095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:30.051520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:30.051520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:30.051520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:30.051520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:30.051520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:30.051520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:30.051520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:30.051520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:30.051520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:30.051520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:30.051520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:30.051520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:30.051520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:30.051520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:30.052591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:30.053498 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:30.053498 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:30.053498 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:30.053498 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:30.053498 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 236/492] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:30.054411 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8345e-4695-4de8-85d0-01a50eb78095 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:30.092233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 257/493] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:30.093160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f8391-b0ee-4ca8-ab5e-1cfa0ea0cf77 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:30.146862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8345e-4695-4de8-85d0-01a50eb78095 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:30.178321 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87da62-b396-496b-b36f-215b413b84f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:30.179635 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87da62-b396-496b-b36f-215b413b84f1 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:30.179910 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87da62-b396-496b-b36f-215b413b84f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:30.180207 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87da62-b396-496b-b36f-215b413b84f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:30.187346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87da62-b396-496b-b36f-215b413b84f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:30.188797 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87da62-b396-496b-b36f-215b413b84f1 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:30.190111 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f8391-b0ee-4ca8-ab5e-1cfa0ea0cf77 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-0c87da62-b396-496b-b36f-215b413b84f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:00:30.203468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:30.204561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:30.205476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:30.205476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:30.205476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:00:30.205476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:00:30.205476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:00:30.205476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:00:30.205476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:00:30.205476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:00:30.205476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 29 20:00:30.205476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:30.205476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 237/494] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Apr 29 20:00:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:30.205476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87da62-b396-496b-b36f-215b413b84f1 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:30.226254 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9489e-d9c4-4705-9966-cbd3dfa8c30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:30.226907 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9489e-d9c4-4705-9966-cbd3dfa8c30b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:30.227193 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9489e-d9c4-4705-9966-cbd3dfa8c30b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:30.227465 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9489e-d9c4-4705-9966-cbd3dfa8c30b None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:30.228208 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9489e-d9c4-4705-9966-cbd3dfa8c30b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:30.228514 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9489e-d9c4-4705-9966-cbd3dfa8c30b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:30.230152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9489e-d9c4-4705-9966-cbd3dfa8c30b None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:30.240863 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 258/495] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:30.242186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9489e-d9c4-4705-9966-cbd3dfa8c30b None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:30.298269 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87da62-b396-496b-b36f-215b413b84f1 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:30.330482 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f30a4-5bf4-42e5-b8a1-e7fc96cb42ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:30.331212 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f30a4-5bf4-42e5-b8a1-e7fc96cb42ae None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:30.331561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f30a4-5bf4-42e5-b8a1-e7fc96cb42ae None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:30.331838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f30a4-5bf4-42e5-b8a1-e7fc96cb42ae None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:30.332618 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f30a4-5bf4-42e5-b8a1-e7fc96cb42ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:30.332910 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f30a4-5bf4-42e5-b8a1-e7fc96cb42ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:30.334291 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f30a4-5bf4-42e5-b8a1-e7fc96cb42ae None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:30.336703 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9489e-d9c4-4705-9966-cbd3dfa8c30b None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:30.346641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 238/496] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:30.347483 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f30a4-5bf4-42e5-b8a1-e7fc96cb42ae None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:30.370953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee898a-ee0c-43cd-8fdb-fb687cbd343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:30.371812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee898a-ee0c-43cd-8fdb-fb687cbd343c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:30.372128 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee898a-ee0c-43cd-8fdb-fb687cbd343c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:30.372399 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee898a-ee0c-43cd-8fdb-fb687cbd343c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:30.382378 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee898a-ee0c-43cd-8fdb-fb687cbd343c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-d1ee898a-ee0c-43cd-8fdb-fb687cbd343c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:30.390160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:30.391040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:30.391874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:30.391874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:30.391874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:30.391874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:30.391874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:30.391874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:30.391874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:30.391874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:30.391874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:30.391874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:30.391874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:30.391874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:30.391874 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 259/497] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:00:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:30.392581 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee898a-ee0c-43cd-8fdb-fb687cbd343c None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:30.447613 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f30a4-5bf4-42e5-b8a1-e7fc96cb42ae None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:30.480130 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fd4fb-5966-47da-9800-20dc6418d11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:30.480791 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fd4fb-5966-47da-9800-20dc6418d11f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:30.481062 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fd4fb-5966-47da-9800-20dc6418d11f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:30.481337 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fd4fb-5966-47da-9800-20dc6418d11f None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:30.482148 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fd4fb-5966-47da-9800-20dc6418d11f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:30.482449 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fd4fb-5966-47da-9800-20dc6418d11f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:30.483860 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fd4fb-5966-47da-9800-20dc6418d11f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:30.488793 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee898a-ee0c-43cd-8fdb-fb687cbd343c None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:30.518751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 239/498] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Apr 29 20:00:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:30.519501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fd4fb-5966-47da-9800-20dc6418d11f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:30.521018 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8280d5-1adb-4dda-ad7f-bf2629b086de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:30.521988 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8280d5-1adb-4dda-ad7f-bf2629b086de None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:30.522208 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8280d5-1adb-4dda-ad7f-bf2629b086de None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:30.522939 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8280d5-1adb-4dda-ad7f-bf2629b086de None admin] PATH_INFO: `/v3/users/glance` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:30.530660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8280d5-1adb-4dda-ad7f-bf2629b086de None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:30.532136 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8280d5-1adb-4dda-ad7f-bf2629b086de None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-6e8280d5-1adb-4dda-ad7f-bf2629b086de None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:00:30.547716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:30.548812 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:30.549889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:30.549889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:30.549889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:00:30.549889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:00:30.549889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:00:30.549889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:00:30.549889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:00:30.549889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:00:30.549889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Apr 29 20:00:30.549889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:30.549889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 260/499] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:30.549889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8280d5-1adb-4dda-ad7f-bf2629b086de None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:30.617874 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fd4fb-5966-47da-9800-20dc6418d11f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:30.642918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8280d5-1adb-4dda-ad7f-bf2629b086de None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:30.649795 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e27266-6718-4c7c-a79c-d660f9df352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:30.650580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e27266-6718-4c7c-a79c-d660f9df352f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:30.650859 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e27266-6718-4c7c-a79c-d660f9df352f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:30.651132 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e27266-6718-4c7c-a79c-d660f9df352f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:30.657858 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e27266-6718-4c7c-a79c-d660f9df352f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:30.659340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e27266-6718-4c7c-a79c-d660f9df352f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-b3e27266-6718-4c7c-a79c-d660f9df352f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:00:30.673979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:30.675005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:30.676295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:30.676295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:30.676295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:00:30.676295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:00:30.676295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:00:30.676295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:00:30.676295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:00:30.676295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:00:30.676295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 20:00:30.676295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:30.677077 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67edacc-38cf-4703-b5c2-d91f8c3e8f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:30.677177 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 240/500] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:30.677177 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e27266-6718-4c7c-a79c-d660f9df352f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:30.680414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67edacc-38cf-4703-b5c2-d91f8c3e8f7d None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:30.680698 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67edacc-38cf-4703-b5c2-d91f8c3e8f7d None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:30.680971 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67edacc-38cf-4703-b5c2-d91f8c3e8f7d None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:30.681723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67edacc-38cf-4703-b5c2-d91f8c3e8f7d None admin] RBAC: Adding query filter params (name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:30.682030 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67edacc-38cf-4703-b5c2-d91f8c3e8f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:30.683417 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67edacc-38cf-4703-b5c2-d91f8c3e8f7d None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:30.691407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 261/501] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Apr 29 20:00:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:30.692221 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67edacc-38cf-4703-b5c2-d91f8c3e8f7d None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:30.768469 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e27266-6718-4c7c-a79c-d660f9df352f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:30.785248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67edacc-38cf-4703-b5c2-d91f8c3e8f7d None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:30.799513 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ca5d8-0b8a-46f1-bfd4-1528fbec1fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:30.800176 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ca5d8-0b8a-46f1-bfd4-1528fbec1fe0 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:30.800455 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ca5d8-0b8a-46f1-bfd4-1528fbec1fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:30.800728 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ca5d8-0b8a-46f1-bfd4-1528fbec1fe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:30.816084 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7650ff-0938-4a53-aab6-c43b4d4de2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:30.816731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7650ff-0938-4a53-aab6-c43b4d4de2c8 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:30.817011 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7650ff-0938-4a53-aab6-c43b4d4de2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:30.817284 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7650ff-0938-4a53-aab6-c43b4d4de2c8 None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:30.818105 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7650ff-0938-4a53-aab6-c43b4d4de2c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:30.818409 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7650ff-0938-4a53-aab6-c43b4d4de2c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:30.820366 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7650ff-0938-4a53-aab6-c43b4d4de2c8 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:30.858068 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 262/502] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Apr 29 20:00:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:30.858920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7650ff-0938-4a53-aab6-c43b4d4de2c8 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:30.867610 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ca5d8-0b8a-46f1-bfd4-1528fbec1fe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:30.869693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ca5d8-0b8a-46f1-bfd4-1528fbec1fe0 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:30.951413 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7650ff-0938-4a53-aab6-c43b4d4de2c8 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:30.968503 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 241/503] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:30.969343 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ca5d8-0b8a-46f1-bfd4-1528fbec1fe0 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:30.983482 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd39fe-f145-4860-a5f3-6687df433355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:30.984182 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd39fe-f145-4860-a5f3-6687df433355 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:30.984524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd39fe-f145-4860-a5f3-6687df433355 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:30.984735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd39fe-f145-4860-a5f3-6687df433355 None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:30.985567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd39fe-f145-4860-a5f3-6687df433355 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:30.985867 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd39fe-f145-4860-a5f3-6687df433355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:30.987285 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd39fe-f145-4860-a5f3-6687df433355 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:31.003304 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 263/504] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Apr 29 20:00:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:31.004112 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd39fe-f145-4860-a5f3-6687df433355 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:31.064824 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ca5d8-0b8a-46f1-bfd4-1528fbec1fe0 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:31.096926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67b14c-2714-4bda-9217-2adf0acec7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:31.097269 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd39fe-f145-4860-a5f3-6687df433355 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:31.097705 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67b14c-2714-4bda-9217-2adf0acec7f2 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:31.097980 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67b14c-2714-4bda-9217-2adf0acec7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:31.098250 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67b14c-2714-4bda-9217-2adf0acec7f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:31.108108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67b14c-2714-4bda-9217-2adf0acec7f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:31.109556 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67b14c-2714-4bda-9217-2adf0acec7f2 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:31.126902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-8e67b14c-2714-4bda-9217-2adf0acec7f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:31.126902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:31.126902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:31.126902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:31.126902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:31.126902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:31.126902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:31.126902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:31.126902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:31.126902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:31.126902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:31.126902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:31.126902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:31.126902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:31.126902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:31.127922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:31.129013 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:31.129013 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:31.129013 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:31.129013 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:31.129013 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 242/505] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:31.129013 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67b14c-2714-4bda-9217-2adf0acec7f2 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:31.131708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362c598-1abb-4466-b9ee-5faf073f2c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:31.132891 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362c598-1abb-4466-b9ee-5faf073f2c7a None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:31.133244 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362c598-1abb-4466-b9ee-5faf073f2c7a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:31.133527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362c598-1abb-4466-b9ee-5faf073f2c7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:31.204772 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362c598-1abb-4466-b9ee-5faf073f2c7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:31.206245 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362c598-1abb-4466-b9ee-5faf073f2c7a None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:31.228429 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67b14c-2714-4bda-9217-2adf0acec7f2 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:31.262077 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddefa6-c881-4bab-a42f-cf7964b9be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:31.262862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddefa6-c881-4bab-a42f-cf7964b9be65 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:31.263147 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddefa6-c881-4bab-a42f-cf7964b9be65 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:31.263423 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddefa6-c881-4bab-a42f-cf7964b9be65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:31.273532 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddefa6-c881-4bab-a42f-cf7964b9be65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:31.274996 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddefa6-c881-4bab-a42f-cf7964b9be65 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:31.291438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-ecddefa6-c881-4bab-a42f-cf7964b9be65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:31.291438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:31.291438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:31.291438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:31.291438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:31.291438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:31.291438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:31.291438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:31.291438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:31.291438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:31.291438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:31.291438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:31.291438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:31.291438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:31.291438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:31.292334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:31.293214 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:31.293214 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:31.293214 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:31.293214 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:31.293214 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 243/506] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:31.293495 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddefa6-c881-4bab-a42f-cf7964b9be65 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:31.306045 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 264/507] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:31.306876 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362c598-1abb-4466-b9ee-5faf073f2c7a None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:31.397471 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddefa6-c881-4bab-a42f-cf7964b9be65 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:31.399594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362c598-1abb-4466-b9ee-5faf073f2c7a None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:31.428140 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8f757-b479-434b-a27e-0512a4c85039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:31.429302 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8f757-b479-434b-a27e-0512a4c85039 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:31.429580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8f757-b479-434b-a27e-0512a4c85039 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:31.429849 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8f757-b479-434b-a27e-0512a4c85039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:31.431820 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b74691-f4a4-43be-96bf-058545fe085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:31.432504 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b74691-f4a4-43be-96bf-058545fe085e None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:31.432779 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b74691-f4a4-43be-96bf-058545fe085e None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:31.433055 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b74691-f4a4-43be-96bf-058545fe085e None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:31.433761 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b74691-f4a4-43be-96bf-058545fe085e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:31.434060 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b74691-f4a4-43be-96bf-058545fe085e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:31.435542 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b74691-f4a4-43be-96bf-058545fe085e None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:31.446817 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 265/508] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:31.447720 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b74691-f4a4-43be-96bf-058545fe085e None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:31.493091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8f757-b479-434b-a27e-0512a4c85039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:31.494558 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8f757-b479-434b-a27e-0512a4c85039 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:31.547639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b74691-f4a4-43be-96bf-058545fe085e None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:31.578798 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dac71-6cf2-4b9a-b2d2-91213568e10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:31.579448 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dac71-6cf2-4b9a-b2d2-91213568e10a None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:31.579724 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dac71-6cf2-4b9a-b2d2-91213568e10a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:31.580016 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dac71-6cf2-4b9a-b2d2-91213568e10a None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:31.580727 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dac71-6cf2-4b9a-b2d2-91213568e10a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:31.581027 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dac71-6cf2-4b9a-b2d2-91213568e10a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:31.582397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dac71-6cf2-4b9a-b2d2-91213568e10a None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:31.588697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 244/509] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:31.589542 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8f757-b479-434b-a27e-0512a4c85039 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:31.597682 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 266/510] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:31.597682 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dac71-6cf2-4b9a-b2d2-91213568e10a None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:31.682590 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8f757-b479-434b-a27e-0512a4c85039 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:31.686265 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dac71-6cf2-4b9a-b2d2-91213568e10a None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:31.714133 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b0d4f-e689-4bc6-aa5e-0140d0bba25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:31.714915 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b0d4f-e689-4bc6-aa5e-0140d0bba25a None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:31.715196 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b0d4f-e689-4bc6-aa5e-0140d0bba25a None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:31.715525 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b0d4f-e689-4bc6-aa5e-0140d0bba25a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:31.717903 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd79df8-0372-4460-9cdc-ae4189613633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:31.718766 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd79df8-0372-4460-9cdc-ae4189613633 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:31.719048 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd79df8-0372-4460-9cdc-ae4189613633 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:31.719317 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd79df8-0372-4460-9cdc-ae4189613633 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:31.725234 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b0d4f-e689-4bc6-aa5e-0140d0bba25a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:31.726969 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd79df8-0372-4460-9cdc-ae4189613633 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:31.727194 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b0d4f-e689-4bc6-aa5e-0140d0bba25a None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:31.728432 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd79df8-0372-4460-9cdc-ae4189613633 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-dfd79df8-0372-4460-9cdc-ae4189613633 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:00:31.743218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:31.744157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:31.745114 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:31.745114 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:31.745114 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:00:31.745114 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:00:31.745114 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:00:31.745114 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:00:31.745114 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:00:31.745114 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:00:31.745114 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Apr 29 20:00:31.745114 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:31.745114 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 267/511] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:00:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:31.745665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-858b0d4f-e689-4bc6-aa5e-0140d0bba25a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:31.745665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:31.745665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:31.745665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:31.745665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:31.745665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:31.745665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:31.745665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:31.745665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:31.745665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:31.745665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:31.745665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:31.745665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:31.745665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:31.745665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:31.746401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:31.747240 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:31.747240 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:31.747240 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:31.747240 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:31.747454 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd79df8-0372-4460-9cdc-ae4189613633 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:31.747519 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 245/512] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:31.747519 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b0d4f-e689-4bc6-aa5e-0140d0bba25a None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:31.839389 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b0d4f-e689-4bc6-aa5e-0140d0bba25a None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:31.839907 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd79df8-0372-4460-9cdc-ae4189613633 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:31.872397 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09103f8e-7d12-4047-b045-a3bd3e813ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:31.872775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf7493-88f3-4af0-88c6-51b0e6fbbf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:31.873167 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09103f8e-7d12-4047-b045-a3bd3e813ae7 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:31.873399 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09103f8e-7d12-4047-b045-a3bd3e813ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:31.873550 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf7493-88f3-4af0-88c6-51b0e6fbbf9e None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:31.873671 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09103f8e-7d12-4047-b045-a3bd3e813ae7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:31.873829 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf7493-88f3-4af0-88c6-51b0e6fbbf9e None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:31.874101 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf7493-88f3-4af0-88c6-51b0e6fbbf9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:31.880163 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09103f8e-7d12-4047-b045-a3bd3e813ae7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:31.881606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09103f8e-7d12-4047-b045-a3bd3e813ae7 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:31.883758 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf7493-88f3-4af0-88c6-51b0e6fbbf9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:31.885219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf7493-88f3-4af0-88c6-51b0e6fbbf9e None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:31.895897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-09103f8e-7d12-4047-b045-a3bd3e813ae7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:31.895897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:31.895897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:31.895897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:31.895897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:31.895897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:31.895897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:31.895897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:31.895897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:31.895897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:31.895897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:31.895897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:31.895897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:00:31.895897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:00:31.895897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:31.896772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:31.898108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:00:31.898108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:00:31.898108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:00:31.898108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:00:31.898108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:00:31.898108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:00:31.898108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:31.898108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:31.898108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 246/513] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:31.898571 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09103f8e-7d12-4047-b045-a3bd3e813ae7 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:31.902914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-fcdf7493-88f3-4af0-88c6-51b0e6fbbf9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:31.902914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:31.902914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:31.902914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:31.902914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:31.902914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:31.902914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:31.902914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:31.902914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:31.902914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:31.902914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:31.902914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:31.902914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:31.902914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:31.902914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:31.903957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:31.904847 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:31.904847 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:31.904847 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:31.904847 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:31.904847 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 268/514] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:31.905118 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf7493-88f3-4af0-88c6-51b0e6fbbf9e None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:31.994031 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09103f8e-7d12-4047-b045-a3bd3e813ae7 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:31.998503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf7493-88f3-4af0-88c6-51b0e6fbbf9e None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:32.026728 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed510ded-3538-40b2-936d-5c9bdbbee9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:32.027388 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed510ded-3538-40b2-936d-5c9bdbbee9eb None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:32.027670 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed510ded-3538-40b2-936d-5c9bdbbee9eb None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:32.027944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed510ded-3538-40b2-936d-5c9bdbbee9eb None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:32.028796 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed510ded-3538-40b2-936d-5c9bdbbee9eb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:32.029102 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed510ded-3538-40b2-936d-5c9bdbbee9eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:32.030526 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e7c31-216f-42c4-b396-2e1f5c4c81c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:32.030637 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed510ded-3538-40b2-936d-5c9bdbbee9eb None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:32.031174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e7c31-216f-42c4-b396-2e1f5c4c81c9 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:32.031450 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e7c31-216f-42c4-b396-2e1f5c4c81c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:32.031720 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e7c31-216f-42c4-b396-2e1f5c4c81c9 None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:32.032463 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e7c31-216f-42c4-b396-2e1f5c4c81c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:32.032761 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e7c31-216f-42c4-b396-2e1f5c4c81c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:32.034121 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e7c31-216f-42c4-b396-2e1f5c4c81c9 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:32.046102 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 269/515] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:32.046893 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e7c31-216f-42c4-b396-2e1f5c4c81c9 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:32.052067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 247/516] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Apr 29 20:00:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:32.052067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed510ded-3538-40b2-936d-5c9bdbbee9eb None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:32.139593 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e7c31-216f-42c4-b396-2e1f5c4c81c9 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:32.241445 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed510ded-3538-40b2-936d-5c9bdbbee9eb None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:32.241947 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ea136-227d-431f-819a-6918c2f6db81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:32.242075 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267dde4-2d6d-47ab-9cd2-133c67a849e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:32.242181 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ea136-227d-431f-819a-6918c2f6db81 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:32.242181 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ea136-227d-431f-819a-6918c2f6db81 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:32.242181 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ea136-227d-431f-819a-6918c2f6db81 None admin] PATH_INFO: `/v3/projects` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:32.242423 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267dde4-2d6d-47ab-9cd2-133c67a849e2 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:32.242423 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267dde4-2d6d-47ab-9cd2-133c67a849e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:32.242423 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267dde4-2d6d-47ab-9cd2-133c67a849e2 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:32.242655 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ea136-227d-431f-819a-6918c2f6db81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:32.242655 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ea136-227d-431f-819a-6918c2f6db81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:32.242816 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267dde4-2d6d-47ab-9cd2-133c67a849e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:32.242816 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267dde4-2d6d-47ab-9cd2-133c67a849e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:32.242971 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ea136-227d-431f-819a-6918c2f6db81 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:32.243056 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267dde4-2d6d-47ab-9cd2-133c67a849e2 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:32.243056 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 248/517] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:32.243056 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267dde4-2d6d-47ab-9cd2-133c67a849e2 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:32.243277 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 270/518] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:32.243277 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ea136-227d-431f-819a-6918c2f6db81 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:32.290686 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267dde4-2d6d-47ab-9cd2-133c67a849e2 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:32.291596 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ea136-227d-431f-819a-6918c2f6db81 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:32.322370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0016ba1-02a4-42ec-a550-ded506f41b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:32.323148 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0016ba1-02a4-42ec-a550-ded506f41b7e None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:32.323419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c076dde-6550-44de-b903-8d4ffecf5f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:32.323532 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0016ba1-02a4-42ec-a550-ded506f41b7e None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:32.323692 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0016ba1-02a4-42ec-a550-ded506f41b7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:32.324081 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c076dde-6550-44de-b903-8d4ffecf5f8c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:32.324358 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c076dde-6550-44de-b903-8d4ffecf5f8c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:32.324628 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c076dde-6550-44de-b903-8d4ffecf5f8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:32.330127 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0016ba1-02a4-42ec-a550-ded506f41b7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:32.331585 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0016ba1-02a4-42ec-a550-ded506f41b7e None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:32.346754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-d0016ba1-02a4-42ec-a550-ded506f41b7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:32.346754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:32.346754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:32.346754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:32.346754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:32.346754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:32.346754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:32.346754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:32.346754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:32.346754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:32.346754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:32.346754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:32.346754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:00:32.346754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:00:32.346754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:32.347781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:32.348783 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:00:32.348783 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:00:32.348783 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:00:32.348783 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:00:32.348783 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:00:32.348783 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:00:32.348783 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:32.348783 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:32.348783 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 249/519] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:32.348783 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0016ba1-02a4-42ec-a550-ded506f41b7e None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:32.392118 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c076dde-6550-44de-b903-8d4ffecf5f8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:32.393497 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c076dde-6550-44de-b903-8d4ffecf5f8c None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:32.440200 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0016ba1-02a4-42ec-a550-ded506f41b7e None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:32.472435 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12693245-366f-4bac-990a-260c93d06dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:32.473209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12693245-366f-4bac-990a-260c93d06dd9 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:32.473491 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12693245-366f-4bac-990a-260c93d06dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:32.473768 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12693245-366f-4bac-990a-260c93d06dd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:32.480506 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12693245-366f-4bac-990a-260c93d06dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:32.481952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12693245-366f-4bac-990a-260c93d06dd9 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:32.485500 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 271/520] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:32.488892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c076dde-6550-44de-b903-8d4ffecf5f8c None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:32.496002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-12693245-366f-4bac-990a-260c93d06dd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:32.496002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:32.496002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:32.496002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:32.496002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:32.496002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:32.496002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:32.496002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:32.496002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:32.496002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:32.496002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:32.496002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:32.496002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:00:32.496002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:00:32.496002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:32.497052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:32.498238 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:00:32.498238 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:00:32.498238 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:00:32.498238 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:00:32.498238 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:00:32.498238 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:00:32.498238 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:32.498238 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:32.498238 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 250/521] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:32.500047 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12693245-366f-4bac-990a-260c93d06dd9 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:32.586029 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c076dde-6550-44de-b903-8d4ffecf5f8c None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:32.612753 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12693245-366f-4bac-990a-260c93d06dd9 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:32.618854 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050a035-ae61-4922-9f13-62ea1b32214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:32.619507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050a035-ae61-4922-9f13-62ea1b32214d None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:32.619786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050a035-ae61-4922-9f13-62ea1b32214d None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:32.620093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050a035-ae61-4922-9f13-62ea1b32214d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:32.620916 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050a035-ae61-4922-9f13-62ea1b32214d None admin] RBAC: Adding query filter params (role.id=30572a63e8c84c0fb551e6f8ea95564a, scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c, user.id=ca4e798ccd784e348136af337bf780f6) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:32.621225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050a035-ae61-4922-9f13-62ea1b32214d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:32.622680 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050a035-ae61-4922-9f13-62ea1b32214d None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:32.627895 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 272/522] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:00:32 2022] GET /identity/v3/role_assignments?user.id=ca4e798ccd784e348136af337bf780f6&scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c&role.id=30572a63e8c84c0fb551e6f8ea95564a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:32.628688 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050a035-ae61-4922-9f13-62ea1b32214d None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:32.650821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34044e-784e-4d76-a465-2f75eedec9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:32.651416 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34044e-784e-4d76-a465-2f75eedec9d2 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:32.651701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34044e-784e-4d76-a465-2f75eedec9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:32.652003 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34044e-784e-4d76-a465-2f75eedec9d2 None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:32.652831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34044e-784e-4d76-a465-2f75eedec9d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:32.653144 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34044e-784e-4d76-a465-2f75eedec9d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:32.654629 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34044e-784e-4d76-a465-2f75eedec9d2 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:32.673626 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 251/523] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:32.674495 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34044e-784e-4d76-a465-2f75eedec9d2 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:32.740530 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050a035-ae61-4922-9f13-62ea1b32214d None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:32.777207 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d15d6-212e-491d-84c0-53956d4a9f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:32.778017 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d15d6-212e-491d-84c0-53956d4a9f12 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:32.778292 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d15d6-212e-491d-84c0-53956d4a9f12 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:32.778583 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d15d6-212e-491d-84c0-53956d4a9f12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:32.783489 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34044e-784e-4d76-a465-2f75eedec9d2 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:32.790329 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d15d6-212e-491d-84c0-53956d4a9f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:32.791839 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d15d6-212e-491d-84c0-53956d4a9f12 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:32.809841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-302d15d6-212e-491d-84c0-53956d4a9f12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:32.809841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:32.809841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:32.809841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:32.809841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:32.809841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:32.809841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:32.809841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:32.809841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:32.809841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:32.809841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:32.809841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:32.809841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:32.809841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:32.809841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:32.810762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:32.811614 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:32.811614 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:32.811614 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:32.811614 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:32.811614 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 273/524] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:32.811898 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d15d6-212e-491d-84c0-53956d4a9f12 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:32.825217 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323581c2-5b66-4afa-a9f4-6013fde92c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:32.825875 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323581c2-5b66-4afa-a9f4-6013fde92c00 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:32.826159 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323581c2-5b66-4afa-a9f4-6013fde92c00 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:32.826435 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323581c2-5b66-4afa-a9f4-6013fde92c00 None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:32.827223 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323581c2-5b66-4afa-a9f4-6013fde92c00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:32.827524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323581c2-5b66-4afa-a9f4-6013fde92c00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:32.828997 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323581c2-5b66-4afa-a9f4-6013fde92c00 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:32.840468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 252/525] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:32.845974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323581c2-5b66-4afa-a9f4-6013fde92c00 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:32.917901 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d15d6-212e-491d-84c0-53956d4a9f12 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:32.957872 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323581c2-5b66-4afa-a9f4-6013fde92c00 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:32.960475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f2982-ad46-46f2-9a65-ad0df6544989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:32.961138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f2982-ad46-46f2-9a65-ad0df6544989 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:32.961419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f2982-ad46-46f2-9a65-ad0df6544989 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:32.961691 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f2982-ad46-46f2-9a65-ad0df6544989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:32.962518 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f2982-ad46-46f2-9a65-ad0df6544989 None admin] RBAC: Adding query filter params (role.id=30572a63e8c84c0fb551e6f8ea95564a, scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c, user.id=685208fceb044edb9970003b5225f3ee) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:32.962827 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f2982-ad46-46f2-9a65-ad0df6544989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:32.965105 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f2982-ad46-46f2-9a65-ad0df6544989 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:32.971266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 274/526] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:00:32 2022] GET /identity/v3/role_assignments?user.id=685208fceb044edb9970003b5225f3ee&scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c&role.id=30572a63e8c84c0fb551e6f8ea95564a => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:32.972440 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f2982-ad46-46f2-9a65-ad0df6544989 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:32.997759 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113a4ac-bbc6-4f4f-b3e2-87e4c157166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:32.998763 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113a4ac-bbc6-4f4f-b3e2-87e4c157166e None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:32.998763 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113a4ac-bbc6-4f4f-b3e2-87e4c157166e None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:32.998763 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113a4ac-bbc6-4f4f-b3e2-87e4c157166e None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:32.999327 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113a4ac-bbc6-4f4f-b3e2-87e4c157166e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:32.999625 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113a4ac-bbc6-4f4f-b3e2-87e4c157166e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:33.001206 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113a4ac-bbc6-4f4f-b3e2-87e4c157166e None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:33.015258 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 253/527] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:33.020757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113a4ac-bbc6-4f4f-b3e2-87e4c157166e None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:33.083237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f2982-ad46-46f2-9a65-ad0df6544989 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:33.119631 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6db3af-ce3b-4fe7-95aa-6bbbefdcb0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:33.120349 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6db3af-ce3b-4fe7-95aa-6bbbefdcb0bb None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:33.120633 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6db3af-ce3b-4fe7-95aa-6bbbefdcb0bb None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:33.120914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6db3af-ce3b-4fe7-95aa-6bbbefdcb0bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:33.121887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6db3af-ce3b-4fe7-95aa-6bbbefdcb0bb None admin] RBAC: Adding query filter params (role.id=30572a63e8c84c0fb551e6f8ea95564a, scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c, user.id=6dc441c13aa14d6ab0446965f0d91aca) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:33.122205 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6db3af-ce3b-4fe7-95aa-6bbbefdcb0bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:33.123723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6db3af-ce3b-4fe7-95aa-6bbbefdcb0bb None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:33.128841 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113a4ac-bbc6-4f4f-b3e2-87e4c157166e None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:33.130414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 275/528] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:00:32 2022] GET /identity/v3/role_assignments?user.id=6dc441c13aa14d6ab0446965f0d91aca&scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c&role.id=30572a63e8c84c0fb551e6f8ea95564a => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:33.171450 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac5a4d-fe71-45e5-a31a-264ed5def298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:33.172244 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac5a4d-fe71-45e5-a31a-264ed5def298 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:33.172574 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac5a4d-fe71-45e5-a31a-264ed5def298 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:33.172921 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac5a4d-fe71-45e5-a31a-264ed5def298 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:33.182113 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac5a4d-fe71-45e5-a31a-264ed5def298 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:33.182618 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac5a4d-fe71-45e5-a31a-264ed5def298 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:33.197662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-9bac5a4d-fe71-45e5-a31a-264ed5def298 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:33.197662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:33.197662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:33.197662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:33.197662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:33.197662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:33.197662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:33.197662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:33.197662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:33.197662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:33.197662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:33.197662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:33.197662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:00:33.197662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:00:33.197662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:33.198600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:33.200631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:00:33.200631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:00:33.200631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:00:33.200631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:00:33.200631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:00:33.200631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:00:33.200631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:33.200631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:33.200631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 254/529] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:33.205033 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6db3af-ce3b-4fe7-95aa-6bbbefdcb0bb None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:33.322842 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6db3af-ce3b-4fe7-95aa-6bbbefdcb0bb None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:33.358698 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57dc83-58f8-424d-bb72-1cabea24d7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:33.359540 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57dc83-58f8-424d-bb72-1cabea24d7a7 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:33.359893 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57dc83-58f8-424d-bb72-1cabea24d7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:33.360259 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57dc83-58f8-424d-bb72-1cabea24d7a7 None admin] PATH_INFO: `/v3/projects` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:33.361123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57dc83-58f8-424d-bb72-1cabea24d7a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:33.361495 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57dc83-58f8-424d-bb72-1cabea24d7a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:33.363002 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57dc83-58f8-424d-bb72-1cabea24d7a7 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:33.376346 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 276/530] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:00:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:33.382239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac5a4d-fe71-45e5-a31a-264ed5def298 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:33.481320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac5a4d-fe71-45e5-a31a-264ed5def298 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:33.514602 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455959e3-453c-4737-90d5-4f168239bea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:33.515254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455959e3-453c-4737-90d5-4f168239bea0 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:33.515538 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455959e3-453c-4737-90d5-4f168239bea0 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:33.515816 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455959e3-453c-4737-90d5-4f168239bea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:33.516674 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455959e3-453c-4737-90d5-4f168239bea0 None admin] RBAC: Adding query filter params (role.id=30572a63e8c84c0fb551e6f8ea95564a, scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c, user.id=a40ef0418f4a4bb7908e685d9f5d2966) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:33.516986 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455959e3-453c-4737-90d5-4f168239bea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:33.518415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455959e3-453c-4737-90d5-4f168239bea0 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:33.524806 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 255/531] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:00:33 2022] GET /identity/v3/role_assignments?user.id=a40ef0418f4a4bb7908e685d9f5d2966&scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c&role.id=30572a63e8c84c0fb551e6f8ea95564a => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:34.972756 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be56399-aa87-4309-a733-5a185f97a8d5 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:34.973282 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be56399-aa87-4309-a733-5a185f97a8d5 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:34.973357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be56399-aa87-4309-a733-5a185f97a8d5 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:34.974893 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 277/532] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:34.981484 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c0c3e-70f8-4e6e-8eb4-f61f4a5673c2 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:34.981917 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c0c3e-70f8-4e6e-8eb4-f61f4a5673c2 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:34.982092 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c0c3e-70f8-4e6e-8eb4-f61f4a5673c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:34.999050 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-579c0c3e-70f8-4e6e-8eb4-f61f4a5673c2 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:35.000278 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-579c0c3e-70f8-4e6e-8eb4-f61f4a5673c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:35.067252 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 256/533] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:35.091764 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be56399-aa87-4309-a733-5a185f97a8d5 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:35.195315 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be56399-aa87-4309-a733-5a185f97a8d5 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:35.234118 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba5dff-7da0-46bd-bf72-c800be3d35ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:35.234838 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba5dff-7da0-46bd-bf72-c800be3d35ea None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:35.235113 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba5dff-7da0-46bd-bf72-c800be3d35ea None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:35.235381 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba5dff-7da0-46bd-bf72-c800be3d35ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:35.245873 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba5dff-7da0-46bd-bf72-c800be3d35ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-07ba5dff-7da0-46bd-bf72-c800be3d35ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:35.253556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:35.254567 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:35.255357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:35.255357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:35.255357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:35.255357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:35.255357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:35.255357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:35.255357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:35.255357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:35.255357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:35.255357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:35.255357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:35.255357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:35.255357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 278/534] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:35.261417 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c0c3e-70f8-4e6e-8eb4-f61f4a5673c2 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:35.365108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c0c3e-70f8-4e6e-8eb4-f61f4a5673c2 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:35.393200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf036068-a2ea-4237-86a0-6bba7981ef4c None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:35.393815 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf036068-a2ea-4237-86a0-6bba7981ef4c None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:35.394094 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf036068-a2ea-4237-86a0-6bba7981ef4c None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:35.396148 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 279/535] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:00:35.404567 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b4d00-d798-44a5-a72f-be07a5f20147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:35.405238 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b4d00-d798-44a5-a72f-be07a5f20147 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:35.405521 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b4d00-d798-44a5-a72f-be07a5f20147 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:35.405795 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b4d00-d798-44a5-a72f-be07a5f20147 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:35.406540 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b4d00-d798-44a5-a72f-be07a5f20147 None admin] RBAC: Adding query filter params (name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:35.406843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b4d00-d798-44a5-a72f-be07a5f20147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:35.408503 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b4d00-d798-44a5-a72f-be07a5f20147 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:35.410211 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8374-7678-40ce-b9ef-dc1488e0140f None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:35.411065 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8374-7678-40ce-b9ef-dc1488e0140f None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:35.411542 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8374-7678-40ce-b9ef-dc1488e0140f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:35.420011 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 257/536] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Apr 29 20:00:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:35.423295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b4d00-d798-44a5-a72f-be07a5f20147 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:35.434632 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-551d8374-7678-40ce-b9ef-dc1488e0140f None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:35.435849 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-551d8374-7678-40ce-b9ef-dc1488e0140f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:35.504981 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 280/537] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:35.529159 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eee9a-5711-46da-8134-8e0eccac330c None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:35.529450 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eee9a-5711-46da-8134-8e0eccac330c None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:35.529716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eee9a-5711-46da-8134-8e0eccac330c None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:35.531167 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 281/538] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:00:35.531723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eee9a-5711-46da-8134-8e0eccac330c None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:35.542503 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b4d00-d798-44a5-a72f-be07a5f20147 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:35.582129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53534d-5f0e-4bea-9f7d-2a1f58ce3440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:35.583214 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53534d-5f0e-4bea-9f7d-2a1f58ce3440 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:35.584119 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53534d-5f0e-4bea-9f7d-2a1f58ce3440 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:35.584582 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53534d-5f0e-4bea-9f7d-2a1f58ce3440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:35.598936 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53534d-5f0e-4bea-9f7d-2a1f58ce3440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:35.600934 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53534d-5f0e-4bea-9f7d-2a1f58ce3440 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:35.618067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-9e53534d-5f0e-4bea-9f7d-2a1f58ce3440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:35.618067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:35.618067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:35.618067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:35.618067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:35.618067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:35.618067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:35.618067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:35.618067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:35.618067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:35.618067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:35.618067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:35.618067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:35.618067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:35.618067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:35.618944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:35.619798 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:35.619798 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:35.619798 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:35.619798 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:35.619798 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 258/539] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:35.620533 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5998e-95d0-42f3-8fb9-f93271f53127 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:35.620795 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5998e-95d0-42f3-8fb9-f93271f53127 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:35.621153 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5998e-95d0-42f3-8fb9-f93271f53127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:35.635395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eee9a-5711-46da-8134-8e0eccac330c None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:35.637316 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-83a5998e-95d0-42f3-8fb9-f93271f53127 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:35.638505 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-83a5998e-95d0-42f3-8fb9-f93271f53127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:35.669666 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7622c-37e4-463a-a27c-431182eda007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:35.670581 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7622c-37e4-463a-a27c-431182eda007 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:35.670867 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7622c-37e4-463a-a27c-431182eda007 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:35.671140 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7622c-37e4-463a-a27c-431182eda007 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:35.683290 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7622c-37e4-463a-a27c-431182eda007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-6bd7622c-37e4-463a-a27c-431182eda007 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:35.691452 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:35.692735 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:35.693548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:35.693548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:35.693548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:35.693548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:35.693548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:35.693548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:35.693548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:35.693548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:35.693548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:35.693548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:35.693548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:35.693548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:35.693548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 282/540] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:35.694772 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7622c-37e4-463a-a27c-431182eda007 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:35.718254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 259/541] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:35.719321 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5998e-95d0-42f3-8fb9-f93271f53127 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:35.806585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7622c-37e4-463a-a27c-431182eda007 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:35.823727 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5998e-95d0-42f3-8fb9-f93271f53127 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:35.839493 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a7aaf-15d9-481a-bc81-7e1d89baf4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:35.840182 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a7aaf-15d9-481a-bc81-7e1d89baf4c1 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:35.840462 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a7aaf-15d9-481a-bc81-7e1d89baf4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:35.840732 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a7aaf-15d9-481a-bc81-7e1d89baf4c1 None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:35.841442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a7aaf-15d9-481a-bc81-7e1d89baf4c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:35.841742 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a7aaf-15d9-481a-bc81-7e1d89baf4c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:35.843125 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a7aaf-15d9-481a-bc81-7e1d89baf4c1 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:35.855035 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 283/542] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:35.855853 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a7aaf-15d9-481a-bc81-7e1d89baf4c1 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:35.856820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143c770-152b-4a88-8ee7-f1a2563674a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:35.857491 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143c770-152b-4a88-8ee7-f1a2563674a7 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:35.857774 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143c770-152b-4a88-8ee7-f1a2563674a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:35.858050 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143c770-152b-4a88-8ee7-f1a2563674a7 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:35.858795 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143c770-152b-4a88-8ee7-f1a2563674a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:35.859098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143c770-152b-4a88-8ee7-f1a2563674a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:35.860518 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143c770-152b-4a88-8ee7-f1a2563674a7 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:35.869088 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 260/543] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Apr 29 20:00:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:35.870332 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a3572-87fb-4098-9beb-0ae266f956ba None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:35.870620 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a3572-87fb-4098-9beb-0ae266f956ba None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:35.870899 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a3572-87fb-4098-9beb-0ae266f956ba None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:35.872381 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 261/544] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:35.873099 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a3572-87fb-4098-9beb-0ae266f956ba None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:35.949936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a7aaf-15d9-481a-bc81-7e1d89baf4c1 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:35.968534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a3572-87fb-4098-9beb-0ae266f956ba None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:35.981996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042270ca-c1d9-48a6-87b9-ef2d1f35608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:35.982789 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042270ca-c1d9-48a6-87b9-ef2d1f35608f None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:35.983064 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042270ca-c1d9-48a6-87b9-ef2d1f35608f None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:35.983332 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042270ca-c1d9-48a6-87b9-ef2d1f35608f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:35.995789 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042270ca-c1d9-48a6-87b9-ef2d1f35608f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:36.001196 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffb08f-08ce-4921-a6d3-c7aabebfc84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:36.001995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffb08f-08ce-4921-a6d3-c7aabebfc84a None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:36.002250 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffb08f-08ce-4921-a6d3-c7aabebfc84a None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:36.002518 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffb08f-08ce-4921-a6d3-c7aabebfc84a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-042270ca-c1d9-48a6-87b9-ef2d1f35608f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:36.003564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:36.004433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:36.005237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:36.005237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:36.005237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:36.005237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:36.005237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:36.005237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:36.005237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:36.005237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:36.005237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:36.005237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:36.005237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:36.005237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:36.005237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 284/545] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:36.006007 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66240717-8145-4be9-89d9-f5a73aeffa3d None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:36.006282 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66240717-8145-4be9-89d9-f5a73aeffa3d None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:36.007121 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66240717-8145-4be9-89d9-f5a73aeffa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:36.015108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffb08f-08ce-4921-a6d3-c7aabebfc84a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:36.016594 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffb08f-08ce-4921-a6d3-c7aabebfc84a None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:36.022926 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-66240717-8145-4be9-89d9-f5a73aeffa3d None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:36.024151 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-66240717-8145-4be9-89d9-f5a73aeffa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-e9ffb08f-08ce-4921-a6d3-c7aabebfc84a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:00:36.030697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:36.031606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:36.032568 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:36.032568 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:36.032568 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:00:36.032568 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:00:36.032568 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:00:36.032568 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:00:36.032568 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:00:36.032568 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:00:36.032568 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 29 20:00:36.032568 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:36.032568 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 262/546] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Apr 29 20:00:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:36.033171 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffb08f-08ce-4921-a6d3-c7aabebfc84a None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:36.087228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 285/547] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:36.088122 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66240717-8145-4be9-89d9-f5a73aeffa3d None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:36.129255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffb08f-08ce-4921-a6d3-c7aabebfc84a None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:36.160499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f05d1-b643-41d2-9835-b1d0e304938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:36.161275 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f05d1-b643-41d2-9835-b1d0e304938b None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:36.161554 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f05d1-b643-41d2-9835-b1d0e304938b None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:36.161831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f05d1-b643-41d2-9835-b1d0e304938b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:36.172050 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f05d1-b643-41d2-9835-b1d0e304938b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:36.173586 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f05d1-b643-41d2-9835-b1d0e304938b None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:36.181907 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66240717-8145-4be9-89d9-f5a73aeffa3d None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:36.191118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-574f05d1-b643-41d2-9835-b1d0e304938b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:36.191118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:36.191118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:36.191118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:36.191118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:36.191118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:36.191118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:36.191118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:36.191118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:36.191118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:36.191118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:36.191118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:36.191118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:36.191118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:36.191118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:36.192270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:36.193145 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:36.193145 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:36.193145 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:36.193145 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:36.193145 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 263/548] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:36.193145 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f05d1-b643-41d2-9835-b1d0e304938b None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:36.215186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e563e3e-0cc6-4f0b-93e7-c05911bc4bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:36.215847 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e563e3e-0cc6-4f0b-93e7-c05911bc4bf0 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:36.216157 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e563e3e-0cc6-4f0b-93e7-c05911bc4bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:36.216430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e563e3e-0cc6-4f0b-93e7-c05911bc4bf0 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:36.217163 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e563e3e-0cc6-4f0b-93e7-c05911bc4bf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:36.217467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e563e3e-0cc6-4f0b-93e7-c05911bc4bf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:36.218824 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e563e3e-0cc6-4f0b-93e7-c05911bc4bf0 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:36.226804 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 286/549] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Apr 29 20:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:36.227570 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e563e3e-0cc6-4f0b-93e7-c05911bc4bf0 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:36.287579 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f05d1-b643-41d2-9835-b1d0e304938b None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:36.319691 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e563e3e-0cc6-4f0b-93e7-c05911bc4bf0 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:36.321899 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69103f-9c8d-4916-b4ac-340050827979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:36.322705 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69103f-9c8d-4916-b4ac-340050827979 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:36.322985 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69103f-9c8d-4916-b4ac-340050827979 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:36.323314 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69103f-9c8d-4916-b4ac-340050827979 None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:36.324242 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69103f-9c8d-4916-b4ac-340050827979 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:36.324550 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69103f-9c8d-4916-b4ac-340050827979 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:36.326030 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69103f-9c8d-4916-b4ac-340050827979 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:36.345044 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 264/550] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Apr 29 20:00:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:36.345925 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69103f-9c8d-4916-b4ac-340050827979 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:36.354586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc08f-cce9-4972-b307-8af42db855db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:36.355377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc08f-cce9-4972-b307-8af42db855db None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:36.355647 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc08f-cce9-4972-b307-8af42db855db None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:36.355909 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abc08f-cce9-4972-b307-8af42db855db None admin] PATH_INFO: `/v3/roles/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:36.365652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abc08f-cce9-4972-b307-8af42db855db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-39abc08f-cce9-4972-b307-8af42db855db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:36.373778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:36.374870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:36.375892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:36.375892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:36.375892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:36.375892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:36.375892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:36.375892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:36.375892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:36.375892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:36.375892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:36.375892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:36.375892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:36.375892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:36.375892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 287/551] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:00:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:36.376729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc08f-cce9-4972-b307-8af42db855db None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:36.443395 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69103f-9c8d-4916-b4ac-340050827979 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:36.469937 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abc08f-cce9-4972-b307-8af42db855db None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:36.474643 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc62500-8246-4386-8f99-bc858b48ee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:36.475817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc62500-8246-4386-8f99-bc858b48ee55 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:36.476136 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc62500-8246-4386-8f99-bc858b48ee55 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:36.476410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc62500-8246-4386-8f99-bc858b48ee55 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:36.477116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc62500-8246-4386-8f99-bc858b48ee55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:36.477419 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc62500-8246-4386-8f99-bc858b48ee55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:36.479056 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc62500-8246-4386-8f99-bc858b48ee55 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:36.489668 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 265/552] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:36.490455 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc62500-8246-4386-8f99-bc858b48ee55 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:36.502195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dabb7c-5c53-4b87-bf26-60cbabd32052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:36.502986 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dabb7c-5c53-4b87-bf26-60cbabd32052 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:36.503275 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dabb7c-5c53-4b87-bf26-60cbabd32052 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:36.503548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dabb7c-5c53-4b87-bf26-60cbabd32052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:36.513631 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dabb7c-5c53-4b87-bf26-60cbabd32052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:36.515082 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dabb7c-5c53-4b87-bf26-60cbabd32052 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:36.531915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-45dabb7c-5c53-4b87-bf26-60cbabd32052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:36.531915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:36.531915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:36.531915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:36.531915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:36.531915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:36.531915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:36.531915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:36.531915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:36.531915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:36.531915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:36.531915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:36.531915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:36.531915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:36.531915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:36.532786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:36.533616 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:36.533616 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:36.533616 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:36.533616 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:36.533616 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 288/553] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:36.533888 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dabb7c-5c53-4b87-bf26-60cbabd32052 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:36.588120 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc62500-8246-4386-8f99-bc858b48ee55 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:36.620189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9cd93-6292-4d5d-890d-ea06352144d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:36.620912 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9cd93-6292-4d5d-890d-ea06352144d5 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:36.621195 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9cd93-6292-4d5d-890d-ea06352144d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:36.621471 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9cd93-6292-4d5d-890d-ea06352144d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:36.629281 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dabb7c-5c53-4b87-bf26-60cbabd32052 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:36.631560 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9cd93-6292-4d5d-890d-ea06352144d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:36.633028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9cd93-6292-4d5d-890d-ea06352144d5 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:36.649953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-38f9cd93-6292-4d5d-890d-ea06352144d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:36.649953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:36.649953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:36.649953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:36.649953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:36.649953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:36.649953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:36.649953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:36.649953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:36.649953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:36.649953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:36.649953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:36.649953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:36.649953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:36.649953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:36.650810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:36.656631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:36.656631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:36.656631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:36.656631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:36.656631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 266/554] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:36.656631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9cd93-6292-4d5d-890d-ea06352144d5 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:36.660790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f0dda-0b29-4079-8663-4d9d54883837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:36.661448 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f0dda-0b29-4079-8663-4d9d54883837 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:36.661724 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f0dda-0b29-4079-8663-4d9d54883837 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:36.662050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f0dda-0b29-4079-8663-4d9d54883837 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:36.663328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f0dda-0b29-4079-8663-4d9d54883837 None admin] RBAC: Adding query filter params (name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:36.663653 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f0dda-0b29-4079-8663-4d9d54883837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:36.665067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f0dda-0b29-4079-8663-4d9d54883837 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:36.672664 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 289/555] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Apr 29 20:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:36.673430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f0dda-0b29-4079-8663-4d9d54883837 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:36.748796 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9cd93-6292-4d5d-890d-ea06352144d5 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:36.765877 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f0dda-0b29-4079-8663-4d9d54883837 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:36.780592 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc2b4-8dc3-4033-b475-30929d06c038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:36.781401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc2b4-8dc3-4033-b475-30929d06c038 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:36.781675 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc2b4-8dc3-4033-b475-30929d06c038 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:36.781942 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc2b4-8dc3-4033-b475-30929d06c038 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:36.789075 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fc2b4-8dc3-4033-b475-30929d06c038 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:36.804487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fc2b4-8dc3-4033-b475-30929d06c038 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:36.804607 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa1cd1-d2e6-4bde-bbfc-a5dc74d128f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:36.804607 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa1cd1-d2e6-4bde-bbfc-a5dc74d128f2 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:36.804607 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa1cd1-d2e6-4bde-bbfc-a5dc74d128f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:36.804607 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa1cd1-d2e6-4bde-bbfc-a5dc74d128f2 None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:36.804921 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa1cd1-d2e6-4bde-bbfc-a5dc74d128f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:36.804921 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa1cd1-d2e6-4bde-bbfc-a5dc74d128f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:36.804921 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa1cd1-d2e6-4bde-bbfc-a5dc74d128f2 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-737fc2b4-8dc3-4033-b475-30929d06c038 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:00:36.805098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:36.805931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:36.806843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:36.806843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:36.806843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:00:36.806843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:00:36.806843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:00:36.806843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:00:36.806843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:00:36.806843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:00:36.806843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Apr 29 20:00:36.806843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:36.806843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 267/556] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:36.806843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc2b4-8dc3-4033-b475-30929d06c038 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:36.813120 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 290/557] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:36.813997 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa1cd1-d2e6-4bde-bbfc-a5dc74d128f2 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:36.904167 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc2b4-8dc3-4033-b475-30929d06c038 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:36.907625 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa1cd1-d2e6-4bde-bbfc-a5dc74d128f2 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:36.935709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76086f3c-3ce5-41e3-aab2-a5827aded04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:36.936401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76086f3c-3ce5-41e3-aab2-a5827aded04f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:36.936686 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76086f3c-3ce5-41e3-aab2-a5827aded04f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:36.936962 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76086f3c-3ce5-41e3-aab2-a5827aded04f None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:36.937681 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76086f3c-3ce5-41e3-aab2-a5827aded04f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:36.937990 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76086f3c-3ce5-41e3-aab2-a5827aded04f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:36.938802 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0ee39-34bd-4f2c-9a8a-a46bd3b7d393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:36.939370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76086f3c-3ce5-41e3-aab2-a5827aded04f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:36.939579 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0ee39-34bd-4f2c-9a8a-a46bd3b7d393 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:36.939854 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0ee39-34bd-4f2c-9a8a-a46bd3b7d393 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:36.940158 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0ee39-34bd-4f2c-9a8a-a46bd3b7d393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:36.950420 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0ee39-34bd-4f2c-9a8a-a46bd3b7d393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:36.951863 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0ee39-34bd-4f2c-9a8a-a46bd3b7d393 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:36.952159 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 268/558] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:36.952956 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76086f3c-3ce5-41e3-aab2-a5827aded04f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:36.973618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-0ac0ee39-34bd-4f2c-9a8a-a46bd3b7d393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:36.973618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:36.973618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:36.973618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:36.973618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:36.973618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:36.973618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:36.973618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:36.973618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:36.973618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:36.973618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:36.973618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:36.973618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:36.973618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:36.973618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:36.974660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:36.975526 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:36.975526 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:36.975526 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:36.975526 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:36.975526 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 291/559] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:36.976142 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0ee39-34bd-4f2c-9a8a-a46bd3b7d393 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:37.050223 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76086f3c-3ce5-41e3-aab2-a5827aded04f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:37.069603 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0ee39-34bd-4f2c-9a8a-a46bd3b7d393 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:37.082251 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2140b-ae0c-48af-984e-5c724bf33a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:37.082922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2140b-ae0c-48af-984e-5c724bf33a1c None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:37.083204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2140b-ae0c-48af-984e-5c724bf33a1c None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:37.083478 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2140b-ae0c-48af-984e-5c724bf33a1c None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:37.084338 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2140b-ae0c-48af-984e-5c724bf33a1c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:37.085294 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2140b-ae0c-48af-984e-5c724bf33a1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:37.086727 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2140b-ae0c-48af-984e-5c724bf33a1c None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:37.102907 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885dc54-707f-4a72-904f-465324d52ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:37.107135 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885dc54-707f-4a72-904f-465324d52ea0 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:37.107245 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 269/560] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Apr 29 20:00:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:37.107341 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885dc54-707f-4a72-904f-465324d52ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:37.107341 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885dc54-707f-4a72-904f-465324d52ea0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:37.107470 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2140b-ae0c-48af-984e-5c724bf33a1c None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:37.111729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885dc54-707f-4a72-904f-465324d52ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:37.113220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885dc54-707f-4a72-904f-465324d52ea0 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-a885dc54-707f-4a72-904f-465324d52ea0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:00:37.128260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:37.129152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:37.130062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:37.130062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:37.130062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:00:37.130062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:00:37.130062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:00:37.130062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:00:37.130062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:00:37.130062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:00:37.130062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 20:00:37.130062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:37.130062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 292/561] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:37.131121 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885dc54-707f-4a72-904f-465324d52ea0 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:37.202724 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2140b-ae0c-48af-984e-5c724bf33a1c None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:37.223186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885dc54-707f-4a72-904f-465324d52ea0 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:37.234209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff513f-726f-41ee-a6e2-8f7d85ec35aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:37.234996 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff513f-726f-41ee-a6e2-8f7d85ec35aa None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:37.235277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff513f-726f-41ee-a6e2-8f7d85ec35aa None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:37.235550 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff513f-726f-41ee-a6e2-8f7d85ec35aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:37.242537 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff513f-726f-41ee-a6e2-8f7d85ec35aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:37.243966 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff513f-726f-41ee-a6e2-8f7d85ec35aa None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:37.254858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89b589-d000-4340-a5c9-03a0dab8d3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:37.255500 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89b589-d000-4340-a5c9-03a0dab8d3f9 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:37.255777 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89b589-d000-4340-a5c9-03a0dab8d3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:37.256078 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89b589-d000-4340-a5c9-03a0dab8d3f9 None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:37.257375 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89b589-d000-4340-a5c9-03a0dab8d3f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:37.257676 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89b589-d000-4340-a5c9-03a0dab8d3f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:37.257983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-e2ff513f-726f-41ee-a6e2-8f7d85ec35aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:37.257983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:37.257983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:37.257983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:37.257983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:37.257983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:37.257983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:37.257983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:37.257983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:37.257983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:37.257983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:37.257983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:37.257983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:00:37.257983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:00:37.257983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:37.258817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:37.259701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:00:37.259701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:00:37.259701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:00:37.259701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:00:37.259701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:00:37.259701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:00:37.259701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:37.259701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:37.260502 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89b589-d000-4340-a5c9-03a0dab8d3f9 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:37.260594 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 270/562] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:37.260594 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff513f-726f-41ee-a6e2-8f7d85ec35aa None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:37.273753 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 293/563] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:37.274554 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89b589-d000-4340-a5c9-03a0dab8d3f9 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:37.356728 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff513f-726f-41ee-a6e2-8f7d85ec35aa None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:37.367089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89b589-d000-4340-a5c9-03a0dab8d3f9 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:37.389293 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8017184-7629-41d4-b5a7-ec0265f8897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:37.390068 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8017184-7629-41d4-b5a7-ec0265f8897e None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:37.390345 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8017184-7629-41d4-b5a7-ec0265f8897e None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:37.390612 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8017184-7629-41d4-b5a7-ec0265f8897e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:37.398718 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f236e-8b7a-4bd4-8343-e975c82a9652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:37.399378 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f236e-8b7a-4bd4-8343-e975c82a9652 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:37.399651 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f236e-8b7a-4bd4-8343-e975c82a9652 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:37.399922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f236e-8b7a-4bd4-8343-e975c82a9652 None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:37.400712 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8017184-7629-41d4-b5a7-ec0265f8897e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:37.400818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f236e-8b7a-4bd4-8343-e975c82a9652 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:37.401059 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f236e-8b7a-4bd4-8343-e975c82a9652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:37.402148 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8017184-7629-41d4-b5a7-ec0265f8897e None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:37.402464 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f236e-8b7a-4bd4-8343-e975c82a9652 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:37.418382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-a8017184-7629-41d4-b5a7-ec0265f8897e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:37.418382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:37.418382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:37.418382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:37.418382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:37.418382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:37.418382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:37.418382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:37.418382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:37.418382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:37.418382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:37.418382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:37.418382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:37.418382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:37.418382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:37.419296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:37.420234 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:37.420234 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:37.420234 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:37.420234 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:37.420455 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 294/564] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Apr 29 20:00:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:37.420455 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f236e-8b7a-4bd4-8343-e975c82a9652 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:37.420617 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 271/565] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:37.420617 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8017184-7629-41d4-b5a7-ec0265f8897e None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:37.515796 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8017184-7629-41d4-b5a7-ec0265f8897e None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:37.516021 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f236e-8b7a-4bd4-8343-e975c82a9652 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:37.546982 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a002c-003c-46d0-8a6f-6a0535527055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:37.547756 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65817c36-6dfc-40c8-9d49-db8ea6781e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:37.547908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a002c-003c-46d0-8a6f-6a0535527055 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:37.548048 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a002c-003c-46d0-8a6f-6a0535527055 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:37.548315 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a002c-003c-46d0-8a6f-6a0535527055 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:37.548488 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65817c36-6dfc-40c8-9d49-db8ea6781e14 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:37.548698 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65817c36-6dfc-40c8-9d49-db8ea6781e14 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:37.548970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65817c36-6dfc-40c8-9d49-db8ea6781e14 None admin] PATH_INFO: `/v3/projects` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:37.549747 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65817c36-6dfc-40c8-9d49-db8ea6781e14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:37.550053 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65817c36-6dfc-40c8-9d49-db8ea6781e14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:37.551473 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65817c36-6dfc-40c8-9d49-db8ea6781e14 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:37.555953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a002c-003c-46d0-8a6f-6a0535527055 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:37.557404 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a002c-003c-46d0-8a6f-6a0535527055 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:37.563011 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 295/566] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:37.563803 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65817c36-6dfc-40c8-9d49-db8ea6781e14 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-d80a002c-003c-46d0-8a6f-6a0535527055 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:00:37.571335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:37.572286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:37.573228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:37.573228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:37.573228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:00:37.573228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:00:37.573228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:00:37.573228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:00:37.573228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:00:37.573228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:00:37.573228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Apr 29 20:00:37.573228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:37.573228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 272/567] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:00:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:37.573849 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a002c-003c-46d0-8a6f-6a0535527055 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:37.658589 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65817c36-6dfc-40c8-9d49-db8ea6781e14 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:37.667414 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a002c-003c-46d0-8a6f-6a0535527055 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:37.691366 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a076017-0e58-410f-85a7-5c2dc7d950b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:37.692170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a076017-0e58-410f-85a7-5c2dc7d950b3 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:37.692446 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a076017-0e58-410f-85a7-5c2dc7d950b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:37.692713 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a076017-0e58-410f-85a7-5c2dc7d950b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:37.698766 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d04fbc-b41c-44dc-9d88-817ca740d538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:37.699412 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d04fbc-b41c-44dc-9d88-817ca740d538 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:37.699694 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d04fbc-b41c-44dc-9d88-817ca740d538 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:37.699993 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d04fbc-b41c-44dc-9d88-817ca740d538 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:37.700772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d04fbc-b41c-44dc-9d88-817ca740d538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:37.701072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d04fbc-b41c-44dc-9d88-817ca740d538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:37.702493 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d04fbc-b41c-44dc-9d88-817ca740d538 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:37.702740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a076017-0e58-410f-85a7-5c2dc7d950b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:37.704219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a076017-0e58-410f-85a7-5c2dc7d950b3 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:37.714585 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 273/568] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:37.715408 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d04fbc-b41c-44dc-9d88-817ca740d538 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:37.724283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-0a076017-0e58-410f-85a7-5c2dc7d950b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:37.724283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:37.724283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:37.724283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:37.724283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:37.724283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:37.724283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:37.724283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:37.724283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:37.724283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:37.724283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:37.724283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:37.724283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:37.724283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:37.724283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:37.726225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:37.732909 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:37.732909 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:37.732909 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:37.732909 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:37.732909 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 296/569] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:37.732909 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a076017-0e58-410f-85a7-5c2dc7d950b3 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:37.812090 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d04fbc-b41c-44dc-9d88-817ca740d538 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:37.828420 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a076017-0e58-410f-85a7-5c2dc7d950b3 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:37.843372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c6860-fd66-4a46-a684-7adf4e4ea75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:37.844286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c6860-fd66-4a46-a684-7adf4e4ea75c None admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:37.844567 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c6860-fd66-4a46-a684-7adf4e4ea75c None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:37.844841 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c6860-fd66-4a46-a684-7adf4e4ea75c None admin] PATH_INFO: `/v3/projects/d13e73e4e3bf4143b30c02ccf7e1a13c/users/ca4e798ccd784e348136af337bf780f6/roles/30572a63e8c84c0fb551e6f8ea95564a` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:37.859305 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c6860-fd66-4a46-a684-7adf4e4ea75c None admin] RBAC: Authorizing `identity:create_grant(project_id=d13e73e4e3bf4143b30c02ccf7e1a13c, user_id=ca4e798ccd784e348136af337bf780f6, role_id=30572a63e8c84c0fb551e6f8ea95564a)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:37.860112 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a6772-98c4-4b56-a9d9-96d4bd65dc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:37.860760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c6860-fd66-4a46-a684-7adf4e4ea75c None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:37.860860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a6772-98c4-4b56-a9d9-96d4bd65dc07 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:37.861039 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a6772-98c4-4b56-a9d9-96d4bd65dc07 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:37.861310 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a6772-98c4-4b56-a9d9-96d4bd65dc07 None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:37.862128 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a6772-98c4-4b56-a9d9-96d4bd65dc07 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:37.862428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a6772-98c4-4b56-a9d9-96d4bd65dc07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:37.863854 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a6772-98c4-4b56-a9d9-96d4bd65dc07 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:37.880638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 297/570] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Apr 29 20:00:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:37.886291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a6772-98c4-4b56-a9d9-96d4bd65dc07 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:37.972164 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a6772-98c4-4b56-a9d9-96d4bd65dc07 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:37.982757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 274/571] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 20:00:37 2022] PUT /identity/v3/projects/d13e73e4e3bf4143b30c02ccf7e1a13c/users/ca4e798ccd784e348136af337bf780f6/roles/30572a63e8c84c0fb551e6f8ea95564a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:00:37.983675 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c6860-fd66-4a46-a684-7adf4e4ea75c None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:38.007912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cb37b-686f-4f6d-b97e-bd1d4b57ca54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:38.008804 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cb37b-686f-4f6d-b97e-bd1d4b57ca54 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:38.009082 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cb37b-686f-4f6d-b97e-bd1d4b57ca54 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:38.009385 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cb37b-686f-4f6d-b97e-bd1d4b57ca54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:38.017894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cb37b-686f-4f6d-b97e-bd1d4b57ca54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:38.019439 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cb37b-686f-4f6d-b97e-bd1d4b57ca54 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:38.036156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-787cb37b-686f-4f6d-b97e-bd1d4b57ca54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:38.036156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:38.036156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:38.036156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:38.036156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:38.036156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:38.036156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:38.036156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:38.036156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:38.036156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:38.036156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:38.036156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:38.036156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:00:38.036156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:00:38.036156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:38.037248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:38.038868 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:00:38.038868 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:00:38.038868 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:00:38.038868 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:00:38.038868 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:00:38.038868 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:00:38.038868 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:38.038868 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:38.038868 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 298/572] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:38.039358 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cb37b-686f-4f6d-b97e-bd1d4b57ca54 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:38.115407 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c6860-fd66-4a46-a684-7adf4e4ea75c None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:38.145614 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cb37b-686f-4f6d-b97e-bd1d4b57ca54 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:38.151863 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356d334-17a6-4931-b722-609bee5c87b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:38.152582 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356d334-17a6-4931-b722-609bee5c87b2 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:38.152929 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356d334-17a6-4931-b722-609bee5c87b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:38.153191 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356d334-17a6-4931-b722-609bee5c87b2 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:38.153866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356d334-17a6-4931-b722-609bee5c87b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:38.154172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356d334-17a6-4931-b722-609bee5c87b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:38.155579 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356d334-17a6-4931-b722-609bee5c87b2 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:38.173954 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 275/573] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:38.173954 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356d334-17a6-4931-b722-609bee5c87b2 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:38.192163 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47991f51-adea-441d-b025-1b6d68976a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:38.193210 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47991f51-adea-441d-b025-1b6d68976a82 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:38.193487 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47991f51-adea-441d-b025-1b6d68976a82 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:38.193959 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47991f51-adea-441d-b025-1b6d68976a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:38.205236 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47991f51-adea-441d-b025-1b6d68976a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:38.207080 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47991f51-adea-441d-b025-1b6d68976a82 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:38.226168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-47991f51-adea-441d-b025-1b6d68976a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:38.226168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:38.226168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:38.226168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:38.226168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:38.226168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:38.226168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:38.226168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:38.226168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:38.226168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:38.226168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:38.226168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:38.226168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:38.226168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:38.226168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:38.227291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:38.228597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:38.228597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:38.228597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:38.228597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:38.228597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 299/574] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:38.229029 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47991f51-adea-441d-b025-1b6d68976a82 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:38.284130 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356d334-17a6-4931-b722-609bee5c87b2 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:38.319506 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc3aa3-d15f-45f7-833a-f8dd4e5264db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:38.320611 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc3aa3-d15f-45f7-833a-f8dd4e5264db None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:38.321055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc3aa3-d15f-45f7-833a-f8dd4e5264db None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:38.321349 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc3aa3-d15f-45f7-833a-f8dd4e5264db None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:38.322117 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc3aa3-d15f-45f7-833a-f8dd4e5264db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:38.322418 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc3aa3-d15f-45f7-833a-f8dd4e5264db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:38.323847 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc3aa3-d15f-45f7-833a-f8dd4e5264db None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:38.330153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47991f51-adea-441d-b025-1b6d68976a82 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:38.336591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 276/575] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:38.337414 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc3aa3-d15f-45f7-833a-f8dd4e5264db None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:38.375581 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dfa65-62d1-44ba-ac40-f39403ed8617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:38.376355 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dfa65-62d1-44ba-ac40-f39403ed8617 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:38.376640 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dfa65-62d1-44ba-ac40-f39403ed8617 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:38.376914 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dfa65-62d1-44ba-ac40-f39403ed8617 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:38.384694 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1dfa65-62d1-44ba-ac40-f39403ed8617 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:38.386026 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1dfa65-62d1-44ba-ac40-f39403ed8617 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:38.400978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-ca1dfa65-62d1-44ba-ac40-f39403ed8617 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:38.400978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:38.400978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:38.400978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:38.400978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:38.400978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:38.400978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:38.400978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:38.400978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:38.400978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:38.400978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:38.400978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:38.400978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:00:38.400978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:00:38.400978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:38.401912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:38.403467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:00:38.403467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:00:38.403467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:00:38.403467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:00:38.403467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:00:38.403467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:00:38.403467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:38.403467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:38.403467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 300/576] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:38.403467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dfa65-62d1-44ba-ac40-f39403ed8617 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:38.441529 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc3aa3-d15f-45f7-833a-f8dd4e5264db None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:38.477364 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b39b95-1345-4c7b-9277-879b5ebfcda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:38.478024 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b39b95-1345-4c7b-9277-879b5ebfcda6 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:38.478305 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b39b95-1345-4c7b-9277-879b5ebfcda6 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:38.478833 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b39b95-1345-4c7b-9277-879b5ebfcda6 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:38.479551 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b39b95-1345-4c7b-9277-879b5ebfcda6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:38.479853 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b39b95-1345-4c7b-9277-879b5ebfcda6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:38.481266 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b39b95-1345-4c7b-9277-879b5ebfcda6 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:38.497110 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 277/577] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:38.497734 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b39b95-1345-4c7b-9277-879b5ebfcda6 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:38.500956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dfa65-62d1-44ba-ac40-f39403ed8617 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:38.535170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dc7ee-cb95-436e-8502-4b5eb30704f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:38.536074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dc7ee-cb95-436e-8502-4b5eb30704f6 None admin] REQUEST_METHOD: `PUT` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:38.536358 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dc7ee-cb95-436e-8502-4b5eb30704f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:38.536627 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dc7ee-cb95-436e-8502-4b5eb30704f6 None admin] PATH_INFO: `/v3/projects/d13e73e4e3bf4143b30c02ccf7e1a13c/users/685208fceb044edb9970003b5225f3ee/roles/30572a63e8c84c0fb551e6f8ea95564a` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:38.551299 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dc7ee-cb95-436e-8502-4b5eb30704f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d13e73e4e3bf4143b30c02ccf7e1a13c, user_id=685208fceb044edb9970003b5225f3ee, role_id=30572a63e8c84c0fb551e6f8ea95564a)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:38.552967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dc7ee-cb95-436e-8502-4b5eb30704f6 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:38.597452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b39b95-1345-4c7b-9277-879b5ebfcda6 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:38.619521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 301/578] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 20:00:38 2022] PUT /identity/v3/projects/d13e73e4e3bf4143b30c02ccf7e1a13c/users/685208fceb044edb9970003b5225f3ee/roles/30572a63e8c84c0fb551e6f8ea95564a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:00:38.629091 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dc7ee-cb95-436e-8502-4b5eb30704f6 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:38.630909 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14efe2d-6904-4b92-adcc-37488ee69b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:38.632160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14efe2d-6904-4b92-adcc-37488ee69b83 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:38.632441 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14efe2d-6904-4b92-adcc-37488ee69b83 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:38.632711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14efe2d-6904-4b92-adcc-37488ee69b83 None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:38.633503 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14efe2d-6904-4b92-adcc-37488ee69b83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:38.633817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14efe2d-6904-4b92-adcc-37488ee69b83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:38.635354 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14efe2d-6904-4b92-adcc-37488ee69b83 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:38.648868 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 278/579] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:38.654253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14efe2d-6904-4b92-adcc-37488ee69b83 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:38.744950 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dc7ee-cb95-436e-8502-4b5eb30704f6 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:38.782125 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390b3a1-562b-4a48-9e23-0bdb2a52063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:38.783041 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390b3a1-562b-4a48-9e23-0bdb2a52063b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:38.783413 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390b3a1-562b-4a48-9e23-0bdb2a52063b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:38.783763 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390b3a1-562b-4a48-9e23-0bdb2a52063b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:38.791261 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390b3a1-562b-4a48-9e23-0bdb2a52063b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:38.792885 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390b3a1-562b-4a48-9e23-0bdb2a52063b None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:38.796266 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14efe2d-6904-4b92-adcc-37488ee69b83 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:38.810524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-2390b3a1-562b-4a48-9e23-0bdb2a52063b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:38.810524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:38.810524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:38.810524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:38.810524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:38.810524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:38.810524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:38.810524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:38.810524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:38.810524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:38.810524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:38.810524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:38.810524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:00:38.810524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:00:38.810524 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:38.811539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:38.812460 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:00:38.812460 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:00:38.812460 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:00:38.812460 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:00:38.812460 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:00:38.812460 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:00:38.812460 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:38.812460 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:38.812460 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 302/580] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:38.817700 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390b3a1-562b-4a48-9e23-0bdb2a52063b None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:38.847347 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9ffa1-db0d-4552-8c42-d5eb7970d528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:38.848612 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9ffa1-db0d-4552-8c42-d5eb7970d528 None admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:38.849148 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9ffa1-db0d-4552-8c42-d5eb7970d528 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:38.849615 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9ffa1-db0d-4552-8c42-d5eb7970d528 None admin] PATH_INFO: `/v3/projects/d13e73e4e3bf4143b30c02ccf7e1a13c/users/6dc441c13aa14d6ab0446965f0d91aca/roles/30572a63e8c84c0fb551e6f8ea95564a` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:38.868407 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9ffa1-db0d-4552-8c42-d5eb7970d528 None admin] RBAC: Authorizing `identity:create_grant(project_id=d13e73e4e3bf4143b30c02ccf7e1a13c, user_id=6dc441c13aa14d6ab0446965f0d91aca, role_id=30572a63e8c84c0fb551e6f8ea95564a)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:38.870951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9ffa1-db0d-4552-8c42-d5eb7970d528 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:38.934444 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390b3a1-562b-4a48-9e23-0bdb2a52063b None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:38.967744 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 279/581] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 20:00:38 2022] PUT /identity/v3/projects/d13e73e4e3bf4143b30c02ccf7e1a13c/users/6dc441c13aa14d6ab0446965f0d91aca/roles/30572a63e8c84c0fb551e6f8ea95564a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 20:00:38.979517 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd2801-3725-492d-867b-69423903d2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:38.980633 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd2801-3725-492d-867b-69423903d2bf None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:38.981162 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd2801-3725-492d-867b-69423903d2bf None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:38.981760 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd2801-3725-492d-867b-69423903d2bf None admin] PATH_INFO: `/v3/projects` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:38.982783 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd2801-3725-492d-867b-69423903d2bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:38.983344 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd2801-3725-492d-867b-69423903d2bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:38.985144 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd2801-3725-492d-867b-69423903d2bf None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:39.000466 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 303/582] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:39.012096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9ffa1-db0d-4552-8c42-d5eb7970d528 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:39.118812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9ffa1-db0d-4552-8c42-d5eb7970d528 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:39.155074 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46479c9a-2521-48b4-b934-f3a2447f6045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:39.155933 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46479c9a-2521-48b4-b934-f3a2447f6045 None admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:39.156243 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46479c9a-2521-48b4-b934-f3a2447f6045 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:39.156513 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46479c9a-2521-48b4-b934-f3a2447f6045 None admin] PATH_INFO: `/v3/projects/d13e73e4e3bf4143b30c02ccf7e1a13c/users/a40ef0418f4a4bb7908e685d9f5d2966/roles/30572a63e8c84c0fb551e6f8ea95564a` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:39.173061 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46479c9a-2521-48b4-b934-f3a2447f6045 None admin] RBAC: Authorizing `identity:create_grant(project_id=d13e73e4e3bf4143b30c02ccf7e1a13c, user_id=a40ef0418f4a4bb7908e685d9f5d2966, role_id=30572a63e8c84c0fb551e6f8ea95564a)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:39.174510 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46479c9a-2521-48b4-b934-f3a2447f6045 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:39.243766 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 280/583] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 20:00:39 2022] PUT /identity/v3/projects/d13e73e4e3bf4143b30c02ccf7e1a13c/users/a40ef0418f4a4bb7908e685d9f5d2966/roles/30572a63e8c84c0fb551e6f8ea95564a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:00:40.336819 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fc3ed-0434-4661-b1f2-db147ae4895e None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:40.337351 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fc3ed-0434-4661-b1f2-db147ae4895e None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:40.337351 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fc3ed-0434-4661-b1f2-db147ae4895e None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:40.338951 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 304/584] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:40.344513 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487f684-4fe9-4f08-b3e5-7740a73219f5 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:40.344513 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487f684-4fe9-4f08-b3e5-7740a73219f5 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:40.344921 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487f684-4fe9-4f08-b3e5-7740a73219f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:40.361815 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-6487f684-4fe9-4f08-b3e5-7740a73219f5 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:40.363011 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-6487f684-4fe9-4f08-b3e5-7740a73219f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:40.430524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 281/585] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:40.455625 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fc3ed-0434-4661-b1f2-db147ae4895e None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:40.557720 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fc3ed-0434-4661-b1f2-db147ae4895e None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:40.591877 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52470b0a-26cb-409c-b630-2593562cd4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:40.592711 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52470b0a-26cb-409c-b630-2593562cd4ed None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:40.592985 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52470b0a-26cb-409c-b630-2593562cd4ed None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:40.593255 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52470b0a-26cb-409c-b630-2593562cd4ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:40.604715 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52470b0a-26cb-409c-b630-2593562cd4ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-52470b0a-26cb-409c-b630-2593562cd4ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:40.612525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:40.614119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:40.614975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:40.614975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:40.614975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:40.614975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:40.614975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:40.614975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:40.614975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:40.614975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:40.614975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:40.614975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:40.614975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:40.614975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:40.614975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 305/586] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:00:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:40.620298 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487f684-4fe9-4f08-b3e5-7740a73219f5 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:40.723153 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487f684-4fe9-4f08-b3e5-7740a73219f5 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:40.758170 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0034f-9d77-45c1-be11-6543df98b711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:40.758835 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0034f-9d77-45c1-be11-6543df98b711 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:40.759110 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0034f-9d77-45c1-be11-6543df98b711 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:40.759383 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0034f-9d77-45c1-be11-6543df98b711 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:40.760151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0034f-9d77-45c1-be11-6543df98b711 None admin] RBAC: Adding query filter params (name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:40.760455 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0034f-9d77-45c1-be11-6543df98b711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:40.761832 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0034f-9d77-45c1-be11-6543df98b711 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:40.770256 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 282/587] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Apr 29 20:00:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:40.775324 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52470b0a-26cb-409c-b630-2593562cd4ed None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:40.881404 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52470b0a-26cb-409c-b630-2593562cd4ed None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:40.916003 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba9b81-c2c3-4f53-a41b-57e547962fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:40.916811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba9b81-c2c3-4f53-a41b-57e547962fdc None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:40.917088 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba9b81-c2c3-4f53-a41b-57e547962fdc None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:40.917904 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba9b81-c2c3-4f53-a41b-57e547962fdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:40.928075 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba9b81-c2c3-4f53-a41b-57e547962fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:40.929724 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba9b81-c2c3-4f53-a41b-57e547962fdc None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:40.949000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-7cba9b81-c2c3-4f53-a41b-57e547962fdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:40.949000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:40.949000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:40.949000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:40.949000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:40.949000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:40.949000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:40.949000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:40.949000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:40.949000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:40.949000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:40.949000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:40.949000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:40.949000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:40.949000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:40.951138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:40.953308 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:40.953308 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:40.953308 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:40.953308 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:40.953308 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 306/588] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:40.956063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0034f-9d77-45c1-be11-6543df98b711 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:41.051264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd10c3-a015-4d26-9cd3-ac82224ae65d None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:41.051624 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd10c3-a015-4d26-9cd3-ac82224ae65d None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:41.051795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd10c3-a015-4d26-9cd3-ac82224ae65d None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:41.053462 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 307/589] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:41.060005 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f11b-f4c4-46c5-aa09-5624afdc72e6 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:41.060005 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f11b-f4c4-46c5-aa09-5624afdc72e6 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:41.060005 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f11b-f4c4-46c5-aa09-5624afdc72e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:41.062042 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0034f-9d77-45c1-be11-6543df98b711 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:41.077594 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-48c0f11b-f4c4-46c5-aa09-5624afdc72e6 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:41.079099 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-48c0f11b-f4c4-46c5-aa09-5624afdc72e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:41.096574 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9ec2e-dd8a-434b-b4ee-a2122c8b8222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:41.097242 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9ec2e-dd8a-434b-b4ee-a2122c8b8222 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:41.097566 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9ec2e-dd8a-434b-b4ee-a2122c8b8222 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:41.097838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9ec2e-dd8a-434b-b4ee-a2122c8b8222 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:41.098591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9ec2e-dd8a-434b-b4ee-a2122c8b8222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:41.098904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9ec2e-dd8a-434b-b4ee-a2122c8b8222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:41.100824 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9ec2e-dd8a-434b-b4ee-a2122c8b8222 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:41.113377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 283/590] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:41.120995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9ec2e-dd8a-434b-b4ee-a2122c8b8222 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:41.163689 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 308/591] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:41.190961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0f11b-f4c4-46c5-aa09-5624afdc72e6 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:41.231110 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9ec2e-dd8a-434b-b4ee-a2122c8b8222 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:41.265791 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f313b32-af53-4238-a698-fac598db8310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:41.266868 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f313b32-af53-4238-a698-fac598db8310 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:41.267299 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f313b32-af53-4238-a698-fac598db8310 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:41.267723 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f313b32-af53-4238-a698-fac598db8310 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:41.276131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f313b32-af53-4238-a698-fac598db8310 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:41.277764 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f313b32-af53-4238-a698-fac598db8310 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-8f313b32-af53-4238-a698-fac598db8310 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:00:41.292704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:41.293862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:41.294970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:41.294970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:41.294970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:00:41.294970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:00:41.294970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:00:41.294970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:00:41.294970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:00:41.294970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:00:41.294970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 29 20:00:41.294970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:41.295510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0f11b-f4c4-46c5-aa09-5624afdc72e6 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:41.297220 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 284/592] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Apr 29 20:00:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:41.305355 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f313b32-af53-4238-a698-fac598db8310 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:41.328687 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f529253-157f-4c6a-8c1c-4a957cc229c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:41.329917 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f529253-157f-4c6a-8c1c-4a957cc229c2 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:41.330418 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f529253-157f-4c6a-8c1c-4a957cc229c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:41.330902 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f529253-157f-4c6a-8c1c-4a957cc229c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:41.342088 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f529253-157f-4c6a-8c1c-4a957cc229c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-0f529253-157f-4c6a-8c1c-4a957cc229c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:41.351256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:41.352231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:41.353079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:41.353079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:41.353079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:41.353079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:41.353079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:41.353079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:41.353079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:41.353079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:41.353079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:41.353079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:41.353079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:41.353079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:41.356048 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 309/593] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:00:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:41.361560 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f529253-157f-4c6a-8c1c-4a957cc229c2 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:41.414160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f313b32-af53-4238-a698-fac598db8310 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:41.452072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242656c6-59f2-4f30-be15-0de5c211202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:41.452780 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242656c6-59f2-4f30-be15-0de5c211202b None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:41.453065 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242656c6-59f2-4f30-be15-0de5c211202b None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:41.453385 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242656c6-59f2-4f30-be15-0de5c211202b None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:41.454242 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242656c6-59f2-4f30-be15-0de5c211202b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:41.454550 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242656c6-59f2-4f30-be15-0de5c211202b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:41.456072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242656c6-59f2-4f30-be15-0de5c211202b None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:41.463713 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f529253-157f-4c6a-8c1c-4a957cc229c2 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:41.480150 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 285/594] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Apr 29 20:00:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:41.480150 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049956b-f6c9-4f38-a5c0-1f9b25001908 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:41.480150 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049956b-f6c9-4f38-a5c0-1f9b25001908 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:41.480150 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049956b-f6c9-4f38-a5c0-1f9b25001908 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:41.482500 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 286/595] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:41.483164 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049956b-f6c9-4f38-a5c0-1f9b25001908 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:41.497752 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abb53d-4970-4f86-98ce-abd9ff5b42c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:41.498417 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abb53d-4970-4f86-98ce-abd9ff5b42c9 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:41.498694 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abb53d-4970-4f86-98ce-abd9ff5b42c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:41.498968 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abb53d-4970-4f86-98ce-abd9ff5b42c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:41.499704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abb53d-4970-4f86-98ce-abd9ff5b42c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:41.500031 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abb53d-4970-4f86-98ce-abd9ff5b42c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:41.501406 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abb53d-4970-4f86-98ce-abd9ff5b42c9 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:41.509659 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 310/596] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Apr 29 20:00:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:41.510834 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfff352-be34-44a6-ab57-f4e9474961ac None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:41.511114 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfff352-be34-44a6-ab57-f4e9474961ac None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:41.511386 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfff352-be34-44a6-ab57-f4e9474961ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:41.527484 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-9cfff352-be34-44a6-ab57-f4e9474961ac None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:41.528680 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-9cfff352-be34-44a6-ab57-f4e9474961ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:41.592966 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049956b-f6c9-4f38-a5c0-1f9b25001908 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:41.608277 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 311/597] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:41.609071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfff352-be34-44a6-ab57-f4e9474961ac None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:41.629775 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63e019-5a5d-4dd3-a87c-e03322f47684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:41.630469 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63e019-5a5d-4dd3-a87c-e03322f47684 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:41.630752 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63e019-5a5d-4dd3-a87c-e03322f47684 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:41.631023 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63e019-5a5d-4dd3-a87c-e03322f47684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:41.695007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63e019-5a5d-4dd3-a87c-e03322f47684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:41.696429 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63e019-5a5d-4dd3-a87c-e03322f47684 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:41.705898 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfff352-be34-44a6-ab57-f4e9474961ac None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:41.738254 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f9a5b-823d-4e79-a308-1981e228f44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:41.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f9a5b-823d-4e79-a308-1981e228f44d None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:41.739338 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f9a5b-823d-4e79-a308-1981e228f44d None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:41.739614 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f9a5b-823d-4e79-a308-1981e228f44d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:41.750097 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f9a5b-823d-4e79-a308-1981e228f44d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:41.751539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f9a5b-823d-4e79-a308-1981e228f44d None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:41.769234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-f49f9a5b-823d-4e79-a308-1981e228f44d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:41.769234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:41.769234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:41.769234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:41.769234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:41.769234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:41.769234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:41.769234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:41.769234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:41.769234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:41.769234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:41.769234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:41.769234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:41.769234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:41.769234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:41.770123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:41.771004 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:41.771004 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:41.771004 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:41.771004 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:41.771004 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 312/598] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:41.771283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f9a5b-823d-4e79-a308-1981e228f44d None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:41.793188 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 287/599] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:41.794522 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deced0f6-f2ab-4f37-accb-f7e6e2a07e0c None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:41.794809 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deced0f6-f2ab-4f37-accb-f7e6e2a07e0c None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:41.795081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deced0f6-f2ab-4f37-accb-f7e6e2a07e0c None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:41.798036 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 288/600] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:41.798036 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deced0f6-f2ab-4f37-accb-f7e6e2a07e0c None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:41.867020 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f9a5b-823d-4e79-a308-1981e228f44d None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:41.892490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deced0f6-f2ab-4f37-accb-f7e6e2a07e0c None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:41.899919 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a82adc-a0f3-4153-9afb-2600d77580d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:41.900753 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a82adc-a0f3-4153-9afb-2600d77580d3 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:41.901033 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a82adc-a0f3-4153-9afb-2600d77580d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:41.901307 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a82adc-a0f3-4153-9afb-2600d77580d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:41.911126 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a82adc-a0f3-4153-9afb-2600d77580d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-53a82adc-a0f3-4153-9afb-2600d77580d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:41.919001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:41.919961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:41.921050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:41.921050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:41.921050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:41.921050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:41.921050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:41.921050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:41.921050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:41.921050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:41.921050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:41.921050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:41.921050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:41.921050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:41.921050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 313/601] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:00:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:41.921050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a82adc-a0f3-4153-9afb-2600d77580d3 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:41.929594 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5bcfe-c597-493d-8def-9c170b400f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:41.930285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5bcfe-c597-493d-8def-9c170b400f08 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:41.937894 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5bcfe-c597-493d-8def-9c170b400f08 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:41.937894 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5bcfe-c597-493d-8def-9c170b400f08 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:41.937894 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5bcfe-c597-493d-8def-9c170b400f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:41.937894 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5bcfe-c597-493d-8def-9c170b400f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:41.937894 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5bcfe-c597-493d-8def-9c170b400f08 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:41.944971 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 289/602] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:41.946226 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad5fa9-9375-4240-846f-8b93c58bebc6 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:41.946448 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad5fa9-9375-4240-846f-8b93c58bebc6 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:41.946719 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad5fa9-9375-4240-846f-8b93c58bebc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:41.962304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-cdad5fa9-9375-4240-846f-8b93c58bebc6 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:41.966740 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-cdad5fa9-9375-4240-846f-8b93c58bebc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:42.016746 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a82adc-a0f3-4153-9afb-2600d77580d3 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:42.030252 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 290/603] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:42.031092 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad5fa9-9375-4240-846f-8b93c58bebc6 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:42.052800 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c6eb5-bdea-4a89-bce9-05a0a50ca7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:42.054203 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c6eb5-bdea-4a89-bce9-05a0a50ca7d2 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:42.054482 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c6eb5-bdea-4a89-bce9-05a0a50ca7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:42.054751 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c6eb5-bdea-4a89-bce9-05a0a50ca7d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:42.065047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c6eb5-bdea-4a89-bce9-05a0a50ca7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:42.066538 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c6eb5-bdea-4a89-bce9-05a0a50ca7d2 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:42.082956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-907c6eb5-bdea-4a89-bce9-05a0a50ca7d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:42.082956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:42.082956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:42.082956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:42.082956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:42.082956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:42.082956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:42.082956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:42.082956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:42.082956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:42.082956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:42.082956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:42.082956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:42.082956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:42.082956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:42.083936 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:42.084961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:42.084961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:42.084961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:42.084961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:42.084961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 314/604] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:42.085753 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c6eb5-bdea-4a89-bce9-05a0a50ca7d2 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:42.141722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad5fa9-9375-4240-846f-8b93c58bebc6 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:42.176539 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e411b1-6f8a-4ef6-a796-672256c01611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:42.177209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e411b1-6f8a-4ef6-a796-672256c01611 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:42.177491 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e411b1-6f8a-4ef6-a796-672256c01611 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:42.177766 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e411b1-6f8a-4ef6-a796-672256c01611 None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:42.179086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e411b1-6f8a-4ef6-a796-672256c01611 None admin] RBAC: Adding query filter params (name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:42.179394 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e411b1-6f8a-4ef6-a796-672256c01611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:42.180833 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e411b1-6f8a-4ef6-a796-672256c01611 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:42.193000 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 291/605] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Apr 29 20:00:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:42.193000 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e411b1-6f8a-4ef6-a796-672256c01611 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:42.198968 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c6eb5-bdea-4a89-bce9-05a0a50ca7d2 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:42.234925 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4edc1-dcc6-44c0-afc4-cf20beb26188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:42.235720 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4edc1-dcc6-44c0-afc4-cf20beb26188 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:42.236022 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4edc1-dcc6-44c0-afc4-cf20beb26188 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:42.236297 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4edc1-dcc6-44c0-afc4-cf20beb26188 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:42.244277 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4edc1-dcc6-44c0-afc4-cf20beb26188 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:42.245772 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4edc1-dcc6-44c0-afc4-cf20beb26188 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-afd4edc1-dcc6-44c0-afc4-cf20beb26188 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:00:42.260220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:42.261238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:42.262154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:42.262154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:42.262154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:00:42.262154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:00:42.262154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:00:42.262154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:00:42.262154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:00:42.262154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:00:42.262154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Apr 29 20:00:42.262154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:42.262154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 315/606] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:42.262809 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4edc1-dcc6-44c0-afc4-cf20beb26188 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:42.289556 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e411b1-6f8a-4ef6-a796-672256c01611 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:42.326570 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b674da1-a536-4573-9fcf-8f2901594dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:42.327848 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b674da1-a536-4573-9fcf-8f2901594dc7 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:42.328326 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b674da1-a536-4573-9fcf-8f2901594dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:42.328607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b674da1-a536-4573-9fcf-8f2901594dc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:42.339156 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b674da1-a536-4573-9fcf-8f2901594dc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-5b674da1-a536-4573-9fcf-8f2901594dc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:42.347158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:42.348185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:42.349051 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:42.349051 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:42.349051 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:42.349051 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:42.349051 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:42.349051 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:42.349051 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:42.349051 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:42.349051 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:42.349051 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:42.349051 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:00:42.349051 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:42.349051 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 292/607] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:00:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:42.349777 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b674da1-a536-4573-9fcf-8f2901594dc7 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:42.368431 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4edc1-dcc6-44c0-afc4-cf20beb26188 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:42.402679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283102da-e99b-42de-8140-1096de85b295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:42.403340 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283102da-e99b-42de-8140-1096de85b295 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:42.403620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283102da-e99b-42de-8140-1096de85b295 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:42.403893 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283102da-e99b-42de-8140-1096de85b295 None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:42.404654 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283102da-e99b-42de-8140-1096de85b295 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:42.404958 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283102da-e99b-42de-8140-1096de85b295 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:42.406326 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283102da-e99b-42de-8140-1096de85b295 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:42.418386 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 316/608] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:42.419174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283102da-e99b-42de-8140-1096de85b295 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:42.447889 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b674da1-a536-4573-9fcf-8f2901594dc7 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:42.480041 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd86f99-0d5f-4030-927b-fc37a68fff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:42.480771 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd86f99-0d5f-4030-927b-fc37a68fff3b None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:42.481044 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd86f99-0d5f-4030-927b-fc37a68fff3b None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:42.481313 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd86f99-0d5f-4030-927b-fc37a68fff3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:42.491339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd86f99-0d5f-4030-927b-fc37a68fff3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:42.492817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd86f99-0d5f-4030-927b-fc37a68fff3b None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:42.509105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-0dd86f99-0d5f-4030-927b-fc37a68fff3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:42.509105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:42.509105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:42.509105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:42.509105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:42.509105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:42.509105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:42.509105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:42.509105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:42.509105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:42.509105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:42.509105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:42.509105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:42.509105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:42.509105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:42.510053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:42.515617 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:42.515617 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:42.515617 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:42.515617 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:42.515617 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 293/609] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:42.515617 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd86f99-0d5f-4030-927b-fc37a68fff3b None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:42.515999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283102da-e99b-42de-8140-1096de85b295 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:42.544124 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf9508-2009-472b-9730-2ec6800ecc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:42.544787 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf9508-2009-472b-9730-2ec6800ecc18 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:42.545065 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf9508-2009-472b-9730-2ec6800ecc18 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:42.545336 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf9508-2009-472b-9730-2ec6800ecc18 None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:42.546153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf9508-2009-472b-9730-2ec6800ecc18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:42.546485 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf9508-2009-472b-9730-2ec6800ecc18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:42.547899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf9508-2009-472b-9730-2ec6800ecc18 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:42.564699 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 317/610] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Apr 29 20:00:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:42.565480 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf9508-2009-472b-9730-2ec6800ecc18 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:42.613046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd86f99-0d5f-4030-927b-fc37a68fff3b None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:42.644609 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6799e77-948e-4542-ad8f-e4af1809109e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:42.645262 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6799e77-948e-4542-ad8f-e4af1809109e None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:42.645540 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6799e77-948e-4542-ad8f-e4af1809109e None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:42.645812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6799e77-948e-4542-ad8f-e4af1809109e None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:42.646544 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6799e77-948e-4542-ad8f-e4af1809109e None admin] RBAC: Adding query filter params (name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:42.646845 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6799e77-948e-4542-ad8f-e4af1809109e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:42.648749 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6799e77-948e-4542-ad8f-e4af1809109e None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:42.656204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 294/611] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Apr 29 20:00:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:42.656981 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6799e77-948e-4542-ad8f-e4af1809109e None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:42.658618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf9508-2009-472b-9730-2ec6800ecc18 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:42.691075 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43ebf1-e251-4497-9af0-fc6e95a7ef06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:42.691863 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43ebf1-e251-4497-9af0-fc6e95a7ef06 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:42.692175 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43ebf1-e251-4497-9af0-fc6e95a7ef06 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:42.692447 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43ebf1-e251-4497-9af0-fc6e95a7ef06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:42.698797 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43ebf1-e251-4497-9af0-fc6e95a7ef06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:42.700253 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43ebf1-e251-4497-9af0-fc6e95a7ef06 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:42.713933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-8a43ebf1-e251-4497-9af0-fc6e95a7ef06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:42.713933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:42.713933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:42.713933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:42.713933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:42.713933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:42.713933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:42.713933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:42.713933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:42.713933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:42.713933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:42.713933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:42.713933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:00:42.713933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:00:42.713933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:42.714790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:42.715712 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:00:42.715712 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:00:42.715712 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:00:42.715712 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:00:42.715712 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:00:42.715712 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:00:42.715712 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:42.715712 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:42.715712 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 318/612] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:42.716222 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43ebf1-e251-4497-9af0-fc6e95a7ef06 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:42.751461 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6799e77-948e-4542-ad8f-e4af1809109e None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:42.784096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe738db-f092-4a30-be89-be691bd88208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:42.784792 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe738db-f092-4a30-be89-be691bd88208 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:42.785077 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe738db-f092-4a30-be89-be691bd88208 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:42.785351 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe738db-f092-4a30-be89-be691bd88208 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:42.786060 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe738db-f092-4a30-be89-be691bd88208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:42.786363 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe738db-f092-4a30-be89-be691bd88208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:42.787727 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe738db-f092-4a30-be89-be691bd88208 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:42.799098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 295/613] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:42.799743 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe738db-f092-4a30-be89-be691bd88208 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:42.816286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43ebf1-e251-4497-9af0-fc6e95a7ef06 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:42.848573 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f7fbc-5f94-4f59-a387-b584a86e73b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:42.849213 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f7fbc-5f94-4f59-a387-b584a86e73b2 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:42.849491 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f7fbc-5f94-4f59-a387-b584a86e73b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:42.849762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f7fbc-5f94-4f59-a387-b584a86e73b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:42.890915 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe738db-f092-4a30-be89-be691bd88208 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:42.913110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f7fbc-5f94-4f59-a387-b584a86e73b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:42.914548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f7fbc-5f94-4f59-a387-b584a86e73b2 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:42.922213 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276d408-e420-4ea4-a6c1-aead625b44df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:42.922988 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276d408-e420-4ea4-a6c1-aead625b44df None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:42.923266 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276d408-e420-4ea4-a6c1-aead625b44df None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:42.923545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276d408-e420-4ea4-a6c1-aead625b44df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:42.933120 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276d408-e420-4ea4-a6c1-aead625b44df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:42.934528 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276d408-e420-4ea4-a6c1-aead625b44df None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:42.951687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-7276d408-e420-4ea4-a6c1-aead625b44df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:42.951687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:42.951687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:42.951687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:42.951687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:42.951687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:42.951687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:42.951687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:42.951687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:42.951687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:42.951687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:42.951687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:42.951687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:42.951687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:42.951687 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:42.952634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:42.953525 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:42.953525 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:42.953525 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:42.953525 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:42.953525 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 296/614] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:42.954200 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276d408-e420-4ea4-a6c1-aead625b44df None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:43.009625 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 319/615] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:43.010388 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f7fbc-5f94-4f59-a387-b584a86e73b2 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:43.053119 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276d408-e420-4ea4-a6c1-aead625b44df None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:43.086200 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc35a4-eba5-49b7-8cbb-97b360e56d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:43.092131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc35a4-eba5-49b7-8cbb-97b360e56d0f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:43.092131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc35a4-eba5-49b7-8cbb-97b360e56d0f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:43.092131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc35a4-eba5-49b7-8cbb-97b360e56d0f None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:43.092131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc35a4-eba5-49b7-8cbb-97b360e56d0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:43.092131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc35a4-eba5-49b7-8cbb-97b360e56d0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:43.092131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc35a4-eba5-49b7-8cbb-97b360e56d0f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:43.101416 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 297/616] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:43.102226 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc35a4-eba5-49b7-8cbb-97b360e56d0f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:43.125060 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f7fbc-5f94-4f59-a387-b584a86e73b2 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:43.157784 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cde15-6d18-4d07-a138-45a8d99f506c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:43.158577 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cde15-6d18-4d07-a138-45a8d99f506c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:43.158854 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cde15-6d18-4d07-a138-45a8d99f506c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:43.159127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cde15-6d18-4d07-a138-45a8d99f506c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:43.165941 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cde15-6d18-4d07-a138-45a8d99f506c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:43.167379 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cde15-6d18-4d07-a138-45a8d99f506c None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-ff8cde15-6d18-4d07-a138-45a8d99f506c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:00:43.181866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:43.182875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:43.183848 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:43.183848 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:43.183848 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:00:43.183848 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:00:43.183848 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:00:43.183848 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:00:43.183848 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:00:43.183848 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:00:43.183848 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 20:00:43.183848 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:43.183848 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 320/617] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:43.183848 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cde15-6d18-4d07-a138-45a8d99f506c None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:43.197386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc35a4-eba5-49b7-8cbb-97b360e56d0f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:43.228772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586d4ae-d141-4c74-91c0-f89b4e0fd2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:43.229427 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586d4ae-d141-4c74-91c0-f89b4e0fd2ff None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:43.229708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586d4ae-d141-4c74-91c0-f89b4e0fd2ff None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:43.229989 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586d4ae-d141-4c74-91c0-f89b4e0fd2ff None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:43.230698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586d4ae-d141-4c74-91c0-f89b4e0fd2ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:43.231000 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586d4ae-d141-4c74-91c0-f89b4e0fd2ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:43.232399 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586d4ae-d141-4c74-91c0-f89b4e0fd2ff None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:43.244091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 298/618] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:43.244874 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586d4ae-d141-4c74-91c0-f89b4e0fd2ff None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:43.280741 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cde15-6d18-4d07-a138-45a8d99f506c None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:43.313008 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f40d7-85a2-42cc-8da6-5679b290a623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:43.313793 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f40d7-85a2-42cc-8da6-5679b290a623 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:43.314070 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f40d7-85a2-42cc-8da6-5679b290a623 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:43.314339 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f40d7-85a2-42cc-8da6-5679b290a623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:43.324505 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f40d7-85a2-42cc-8da6-5679b290a623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:43.325953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f40d7-85a2-42cc-8da6-5679b290a623 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:43.336900 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586d4ae-d141-4c74-91c0-f89b4e0fd2ff None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:43.344010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-af0f40d7-85a2-42cc-8da6-5679b290a623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:43.344010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:43.344010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:43.344010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:43.344010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:43.344010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:43.344010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:43.344010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:43.344010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:43.344010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:43.344010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:43.344010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:43.344010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:43.344010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:43.344010 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:43.345074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:43.346151 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:43.346151 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:43.346151 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:43.346151 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:43.346151 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 321/619] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:43.346151 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f40d7-85a2-42cc-8da6-5679b290a623 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:43.374192 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e6e9-7ab9-4978-aa9c-2b75df2ad7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:43.374850 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e6e9-7ab9-4978-aa9c-2b75df2ad7eb None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:43.375130 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e6e9-7ab9-4978-aa9c-2b75df2ad7eb None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:43.375404 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e6e9-7ab9-4978-aa9c-2b75df2ad7eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:43.376272 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922e6e9-7ab9-4978-aa9c-2b75df2ad7eb None admin] RBAC: Adding query filter params (role.id=30572a63e8c84c0fb551e6f8ea95564a, scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c, user.id=ca4e798ccd784e348136af337bf780f6) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:43.376584 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922e6e9-7ab9-4978-aa9c-2b75df2ad7eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:43.378003 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922e6e9-7ab9-4978-aa9c-2b75df2ad7eb None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:43.384241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 299/620] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:00:43 2022] GET /identity/v3/role_assignments?user.id=ca4e798ccd784e348136af337bf780f6&scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c&role.id=30572a63e8c84c0fb551e6f8ea95564a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:43.385017 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e6e9-7ab9-4978-aa9c-2b75df2ad7eb None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:43.449623 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f40d7-85a2-42cc-8da6-5679b290a623 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:43.484847 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79988515-ab15-4f37-af63-14b793ea60aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:43.485532 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79988515-ab15-4f37-af63-14b793ea60aa None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:43.485807 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79988515-ab15-4f37-af63-14b793ea60aa None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:43.486078 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79988515-ab15-4f37-af63-14b793ea60aa None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:43.486920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79988515-ab15-4f37-af63-14b793ea60aa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:43.487226 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79988515-ab15-4f37-af63-14b793ea60aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:43.488704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79988515-ab15-4f37-af63-14b793ea60aa None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:43.491556 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e6e9-7ab9-4978-aa9c-2b75df2ad7eb None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:43.507853 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 322/621] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Apr 29 20:00:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:43.508736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79988515-ab15-4f37-af63-14b793ea60aa None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:43.525930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be4d27-4d28-4298-a76e-f04bab67d514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:43.526737 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be4d27-4d28-4298-a76e-f04bab67d514 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:43.527019 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be4d27-4d28-4298-a76e-f04bab67d514 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:43.527295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be4d27-4d28-4298-a76e-f04bab67d514 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:43.535552 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be4d27-4d28-4298-a76e-f04bab67d514 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:43.536971 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be4d27-4d28-4298-a76e-f04bab67d514 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-c2be4d27-4d28-4298-a76e-f04bab67d514 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:00:43.552391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:43.554095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:43.555048 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:43.555048 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:43.555048 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:00:43.555048 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:00:43.555048 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:00:43.555048 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:00:43.555048 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:00:43.555048 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:00:43.555048 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Apr 29 20:00:43.555048 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:43.558952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 300/622] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:00:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:43.559915 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be4d27-4d28-4298-a76e-f04bab67d514 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:43.611033 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79988515-ab15-4f37-af63-14b793ea60aa None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:43.652718 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362d86b-7823-48f2-945f-676d46d3cb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:43.653384 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362d86b-7823-48f2-945f-676d46d3cb82 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:43.653658 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362d86b-7823-48f2-945f-676d46d3cb82 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:43.653927 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362d86b-7823-48f2-945f-676d46d3cb82 None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:43.654645 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362d86b-7823-48f2-945f-676d46d3cb82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:43.654942 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362d86b-7823-48f2-945f-676d46d3cb82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:43.656346 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362d86b-7823-48f2-945f-676d46d3cb82 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:43.665798 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be4d27-4d28-4298-a76e-f04bab67d514 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:43.668658 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 323/623] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:43.671375 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362d86b-7823-48f2-945f-676d46d3cb82 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:43.700138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdde077-3f06-49b8-bf0d-b011f3ad307f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:43.700784 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdde077-3f06-49b8-bf0d-b011f3ad307f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:43.701078 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdde077-3f06-49b8-bf0d-b011f3ad307f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:43.701345 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdde077-3f06-49b8-bf0d-b011f3ad307f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:43.767837 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdde077-3f06-49b8-bf0d-b011f3ad307f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:43.768410 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362d86b-7823-48f2-945f-676d46d3cb82 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:43.769332 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdde077-3f06-49b8-bf0d-b011f3ad307f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:43.801215 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5632c96-ab2f-4226-9d1f-a3c013589fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:43.801811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5632c96-ab2f-4226-9d1f-a3c013589fe2 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:43.802090 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5632c96-ab2f-4226-9d1f-a3c013589fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:43.802362 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5632c96-ab2f-4226-9d1f-a3c013589fe2 None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:43.803751 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5632c96-ab2f-4226-9d1f-a3c013589fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:43.804086 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5632c96-ab2f-4226-9d1f-a3c013589fe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:43.805514 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5632c96-ab2f-4226-9d1f-a3c013589fe2 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:43.826378 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 324/624] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Apr 29 20:00:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:43.826378 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5632c96-ab2f-4226-9d1f-a3c013589fe2 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:43.876099 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 301/625] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:43.876099 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdde077-3f06-49b8-bf0d-b011f3ad307f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:43.926436 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5632c96-ab2f-4226-9d1f-a3c013589fe2 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:43.958507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d517f9-9384-4dfd-8c09-489f578a43a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:43.959289 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d517f9-9384-4dfd-8c09-489f578a43a0 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:43.960222 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d517f9-9384-4dfd-8c09-489f578a43a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:43.960493 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d517f9-9384-4dfd-8c09-489f578a43a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:43.967205 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d517f9-9384-4dfd-8c09-489f578a43a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:43.968716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d517f9-9384-4dfd-8c09-489f578a43a0 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:43.978592 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdde077-3f06-49b8-bf0d-b011f3ad307f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:43.982852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-f5d517f9-9384-4dfd-8c09-489f578a43a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:43.982852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:43.982852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:43.982852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:43.982852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:43.982852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:43.982852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:43.982852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:43.982852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:43.982852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:43.982852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:43.982852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:43.982852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:00:43.982852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:00:43.982852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:43.983697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:43.984685 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:00:43.984685 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:00:43.984685 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:00:43.984685 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:00:43.984685 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:00:43.984685 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:00:43.984685 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:43.984685 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:43.984685 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 325/626] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:43.985233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d517f9-9384-4dfd-8c09-489f578a43a0 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:44.014517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32b655-895d-4cb1-a5bb-657e111ef34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:44.015500 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32b655-895d-4cb1-a5bb-657e111ef34c None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:44.016009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32b655-895d-4cb1-a5bb-657e111ef34c None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:44.016479 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32b655-895d-4cb1-a5bb-657e111ef34c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:44.084225 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32b655-895d-4cb1-a5bb-657e111ef34c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:44.086392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32b655-895d-4cb1-a5bb-657e111ef34c None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:44.087465 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d517f9-9384-4dfd-8c09-489f578a43a0 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:44.121395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c1bb2-bc42-4ede-a281-218b649131ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:44.122243 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c1bb2-bc42-4ede-a281-218b649131ef None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:44.122526 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c1bb2-bc42-4ede-a281-218b649131ef None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:44.122790 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c1bb2-bc42-4ede-a281-218b649131ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:44.133023 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c1bb2-bc42-4ede-a281-218b649131ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:44.134465 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c1bb2-bc42-4ede-a281-218b649131ef None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:44.151944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-466c1bb2-bc42-4ede-a281-218b649131ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:44.151944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:44.151944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:44.151944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:44.151944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:44.151944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:44.151944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:44.151944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:44.151944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:44.151944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:44.151944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:44.151944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:44.151944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:44.151944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:44.151944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:44.152892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:44.153782 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:44.153782 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:44.153782 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:44.153782 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:44.153782 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 326/627] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:44.154063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c1bb2-bc42-4ede-a281-218b649131ef None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:44.202894 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 302/628] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:44.202894 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32b655-895d-4cb1-a5bb-657e111ef34c None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:44.264578 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c1bb2-bc42-4ede-a281-218b649131ef None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:44.298105 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03181e93-204e-4891-bc6e-762ce0bb1063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:44.298318 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32b655-895d-4cb1-a5bb-657e111ef34c None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:44.298768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03181e93-204e-4891-bc6e-762ce0bb1063 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:44.299048 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03181e93-204e-4891-bc6e-762ce0bb1063 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:44.299319 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03181e93-204e-4891-bc6e-762ce0bb1063 None admin] PATH_INFO: `/v3/projects` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:44.300138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03181e93-204e-4891-bc6e-762ce0bb1063 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:44.300449 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03181e93-204e-4891-bc6e-762ce0bb1063 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:44.301883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03181e93-204e-4891-bc6e-762ce0bb1063 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:44.314711 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 327/629] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:44.315716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03181e93-204e-4891-bc6e-762ce0bb1063 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:44.340431 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafb597-c259-48d0-ad07-861666947ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:44.341095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafb597-c259-48d0-ad07-861666947ce6 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:44.341371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafb597-c259-48d0-ad07-861666947ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:44.341641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafb597-c259-48d0-ad07-861666947ce6 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:44.342358 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafb597-c259-48d0-ad07-861666947ce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:44.342661 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafb597-c259-48d0-ad07-861666947ce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:44.344163 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafb597-c259-48d0-ad07-861666947ce6 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:44.363336 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 303/630] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:44.363336 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafb597-c259-48d0-ad07-861666947ce6 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:44.420540 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03181e93-204e-4891-bc6e-762ce0bb1063 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:44.457230 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad190174-941a-4532-bf73-ef9693ef2091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:44.458054 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190174-941a-4532-bf73-ef9693ef2091 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:44.458299 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190174-941a-4532-bf73-ef9693ef2091 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:44.458574 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190174-941a-4532-bf73-ef9693ef2091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:44.461454 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafb597-c259-48d0-ad07-861666947ce6 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:44.469136 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad190174-941a-4532-bf73-ef9693ef2091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:44.470596 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad190174-941a-4532-bf73-ef9693ef2091 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:44.488365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-ad190174-941a-4532-bf73-ef9693ef2091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:44.488365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:44.488365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:44.488365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:44.488365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:44.488365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:44.488365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:44.488365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:44.488365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:44.488365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:44.488365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:44.488365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:44.488365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:44.488365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:44.488365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:44.489644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:44.490727 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:44.490727 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:44.490727 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:44.490727 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:44.490727 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 328/631] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:44.490727 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad190174-941a-4532-bf73-ef9693ef2091 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:44.502066 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c7bb0-d65f-4128-bb74-ffd5ef6b9313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:44.503303 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c7bb0-d65f-4128-bb74-ffd5ef6b9313 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:44.503590 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c7bb0-d65f-4128-bb74-ffd5ef6b9313 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:44.503867 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c7bb0-d65f-4128-bb74-ffd5ef6b9313 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:44.504759 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c7bb0-d65f-4128-bb74-ffd5ef6b9313 None admin] RBAC: Adding query filter params (role.id=30572a63e8c84c0fb551e6f8ea95564a, scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c, user.id=685208fceb044edb9970003b5225f3ee) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:44.505071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c7bb0-d65f-4128-bb74-ffd5ef6b9313 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:44.506986 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c7bb0-d65f-4128-bb74-ffd5ef6b9313 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:44.512919 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 304/632] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:00:44 2022] GET /identity/v3/role_assignments?user.id=685208fceb044edb9970003b5225f3ee&scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c&role.id=30572a63e8c84c0fb551e6f8ea95564a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:44.513972 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c7bb0-d65f-4128-bb74-ffd5ef6b9313 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:44.597047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad190174-941a-4532-bf73-ef9693ef2091 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:44.633354 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c7bb0-d65f-4128-bb74-ffd5ef6b9313 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:44.635160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0ba06-2574-484f-802f-647a203b1cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:44.636025 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0ba06-2574-484f-802f-647a203b1cd8 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:44.636327 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0ba06-2574-484f-802f-647a203b1cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:44.636612 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0ba06-2574-484f-802f-647a203b1cd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:44.645700 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0ba06-2574-484f-802f-647a203b1cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:44.647081 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0ba06-2574-484f-802f-647a203b1cd8 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:44.662046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-a9c0ba06-2574-484f-802f-647a203b1cd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:44.662046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:44.662046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:44.662046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:44.662046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:44.662046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:44.662046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:44.662046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:44.662046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:44.662046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:44.662046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:44.662046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:44.662046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:00:44.662046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:00:44.662046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:44.663071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:44.663996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:00:44.663996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:00:44.663996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:00:44.663996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:00:44.663996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:00:44.663996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:00:44.663996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:44.663996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:44.663996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 329/633] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:44.676032 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0ba06-2574-484f-802f-647a203b1cd8 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:44.676257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b8824-0498-4ef2-aea6-538315267b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:44.676257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b8824-0498-4ef2-aea6-538315267b23 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:44.676680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b8824-0498-4ef2-aea6-538315267b23 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:44.676921 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b8824-0498-4ef2-aea6-538315267b23 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:44.677636 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b8824-0498-4ef2-aea6-538315267b23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:44.677944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b8824-0498-4ef2-aea6-538315267b23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:44.679903 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b8824-0498-4ef2-aea6-538315267b23 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:44.692851 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 305/634] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:44.699087 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b8824-0498-4ef2-aea6-538315267b23 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:44.781174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0ba06-2574-484f-802f-647a203b1cd8 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:44.807030 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b8824-0498-4ef2-aea6-538315267b23 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:44.820742 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038fb96-7c77-4ee2-8128-954a8d4fb24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:44.821644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038fb96-7c77-4ee2-8128-954a8d4fb24b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:44.822020 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038fb96-7c77-4ee2-8128-954a8d4fb24b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:44.822358 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038fb96-7c77-4ee2-8128-954a8d4fb24b None admin] PATH_INFO: `/v3/projects` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:44.823800 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038fb96-7c77-4ee2-8128-954a8d4fb24b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:44.823911 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038fb96-7c77-4ee2-8128-954a8d4fb24b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:44.825885 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038fb96-7c77-4ee2-8128-954a8d4fb24b None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:44.839676 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 330/635] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:44.847278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038fb96-7c77-4ee2-8128-954a8d4fb24b None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:44.852208 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf96b0-0127-4771-a5b9-d9de2abb34ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:44.852847 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf96b0-0127-4771-a5b9-d9de2abb34ae None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:44.853132 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf96b0-0127-4771-a5b9-d9de2abb34ae None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:44.853664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf96b0-0127-4771-a5b9-d9de2abb34ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:44.860838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf96b0-0127-4771-a5b9-d9de2abb34ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:44.862102 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf96b0-0127-4771-a5b9-d9de2abb34ae None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:44.877116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-9cbf96b0-0127-4771-a5b9-d9de2abb34ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:44.877116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:44.877116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:44.877116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:44.877116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:44.877116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:44.877116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:44.877116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:44.877116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:44.877116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:44.877116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:44.877116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:44.877116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:00:44.877116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:00:44.877116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:44.878057 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:44.878987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:00:44.878987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:00:44.878987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:00:44.878987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:00:44.878987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:00:44.878987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:00:44.878987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:44.878987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:44.878987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 306/636] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:44.885047 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf96b0-0127-4771-a5b9-d9de2abb34ae None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:44.972204 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038fb96-7c77-4ee2-8128-954a8d4fb24b None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:44.992191 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf96b0-0127-4771-a5b9-d9de2abb34ae None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:45.016064 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd2a3c-0462-4790-bad5-c442adda88bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:45.017033 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd2a3c-0462-4790-bad5-c442adda88bc None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:45.017416 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd2a3c-0462-4790-bad5-c442adda88bc None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:45.018138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd2a3c-0462-4790-bad5-c442adda88bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:45.019348 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd2a3c-0462-4790-bad5-c442adda88bc None admin] RBAC: Adding query filter params (role.id=30572a63e8c84c0fb551e6f8ea95564a, scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c, user.id=6dc441c13aa14d6ab0446965f0d91aca) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:45.019783 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd2a3c-0462-4790-bad5-c442adda88bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:45.021952 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd2a3c-0462-4790-bad5-c442adda88bc None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:45.032068 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d42cdc-ea89-44fe-8f11-4132345a1892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:45.032255 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 331/637] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:00:44 2022] GET /identity/v3/role_assignments?user.id=6dc441c13aa14d6ab0446965f0d91aca&scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c&role.id=30572a63e8c84c0fb551e6f8ea95564a => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:45.036942 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d42cdc-ea89-44fe-8f11-4132345a1892 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:45.038146 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d42cdc-ea89-44fe-8f11-4132345a1892 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:45.038658 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d42cdc-ea89-44fe-8f11-4132345a1892 None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:45.039709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d42cdc-ea89-44fe-8f11-4132345a1892 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:45.040287 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d42cdc-ea89-44fe-8f11-4132345a1892 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:45.042034 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d42cdc-ea89-44fe-8f11-4132345a1892 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:45.057516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 307/638] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:45.065200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd2a3c-0462-4790-bad5-c442adda88bc None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:45.182608 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd2a3c-0462-4790-bad5-c442adda88bc None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:45.217945 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c1be4-c210-4672-8f53-7b321610900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:45.218612 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c1be4-c210-4672-8f53-7b321610900c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:45.218889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c1be4-c210-4672-8f53-7b321610900c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:45.219164 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c1be4-c210-4672-8f53-7b321610900c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:45.220003 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c1be4-c210-4672-8f53-7b321610900c None admin] RBAC: Adding query filter params (role.id=30572a63e8c84c0fb551e6f8ea95564a, scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c, user.id=a40ef0418f4a4bb7908e685d9f5d2966) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:45.220322 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c1be4-c210-4672-8f53-7b321610900c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:45.221755 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c1be4-c210-4672-8f53-7b321610900c None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:45.229249 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 332/639] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:00:45 2022] GET /identity/v3/role_assignments?user.id=a40ef0418f4a4bb7908e685d9f5d2966&scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c&role.id=30572a63e8c84c0fb551e6f8ea95564a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:45.793933 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da249613-25f4-4356-8414-ad876ceea7b6 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:45.794479 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da249613-25f4-4356-8414-ad876ceea7b6 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:45.794479 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da249613-25f4-4356-8414-ad876ceea7b6 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:45.796089 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 308/640] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:45.801457 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9815d-1889-441a-8951-d18830953ba6 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:45.801860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9815d-1889-441a-8951-d18830953ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:45.802061 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9815d-1889-441a-8951-d18830953ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:45.820256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-29c9815d-1889-441a-8951-d18830953ba6 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:45.821494 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-29c9815d-1889-441a-8951-d18830953ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:45.893639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 333/641] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:45.918613 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da249613-25f4-4356-8414-ad876ceea7b6 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:46.020745 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da249613-25f4-4356-8414-ad876ceea7b6 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:46.055963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5b20a-67da-434e-9c5b-fcc5d86a071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:46.057129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5b20a-67da-434e-9c5b-fcc5d86a071a None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:46.057643 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5b20a-67da-434e-9c5b-fcc5d86a071a None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:46.058129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5b20a-67da-434e-9c5b-fcc5d86a071a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:46.069162 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5b20a-67da-434e-9c5b-fcc5d86a071a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-5aa5b20a-67da-434e-9c5b-fcc5d86a071a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:46.077236 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:46.078253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:46.079235 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:46.079235 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:46.079235 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:46.079235 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:46.079235 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:46.079235 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:46.079235 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:46.079235 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:46.079235 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:46.079235 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:46.079235 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:00:46.079235 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:46.081979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 309/642] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 20:00:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:46.088257 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9815d-1889-441a-8951-d18830953ba6 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:46.189520 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9815d-1889-441a-8951-d18830953ba6 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:46.224315 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd520a3-70cf-445a-8c47-d89d16d480f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:46.225026 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd520a3-70cf-445a-8c47-d89d16d480f2 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:46.225372 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd520a3-70cf-445a-8c47-d89d16d480f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:46.225649 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd520a3-70cf-445a-8c47-d89d16d480f2 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:46.226445 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd520a3-70cf-445a-8c47-d89d16d480f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:46.226755 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd520a3-70cf-445a-8c47-d89d16d480f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:46.228410 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd520a3-70cf-445a-8c47-d89d16d480f2 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:46.237387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 334/643] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:46.243377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5b20a-67da-434e-9c5b-fcc5d86a071a None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:46.348002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5b20a-67da-434e-9c5b-fcc5d86a071a None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:46.380018 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d799b3-e683-4fd5-92b8-7a03de3c8c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:46.380821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d799b3-e683-4fd5-92b8-7a03de3c8c3f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:46.381128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d799b3-e683-4fd5-92b8-7a03de3c8c3f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:46.381936 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d799b3-e683-4fd5-92b8-7a03de3c8c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:46.393585 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d799b3-e683-4fd5-92b8-7a03de3c8c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:46.395039 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d799b3-e683-4fd5-92b8-7a03de3c8c3f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:46.412433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-d3d799b3-e683-4fd5-92b8-7a03de3c8c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:46.412433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:46.412433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:46.412433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:46.412433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:46.412433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:46.412433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:46.412433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:46.412433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:46.412433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:46.412433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:46.412433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:46.412433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:46.412433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:46.412433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:46.413377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:46.414946 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:46.414946 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:46.414946 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:46.414946 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:46.414946 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 310/644] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:46.419260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd520a3-70cf-445a-8c47-d89d16d480f2 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:46.525334 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd520a3-70cf-445a-8c47-d89d16d480f2 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:46.560191 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b52898-d8b2-4d17-9811-0872e3f853a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:46.560856 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b52898-d8b2-4d17-9811-0872e3f853a6 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:46.561135 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b52898-d8b2-4d17-9811-0872e3f853a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:46.561408 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b52898-d8b2-4d17-9811-0872e3f853a6 None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:46.562130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b52898-d8b2-4d17-9811-0872e3f853a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:46.562436 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b52898-d8b2-4d17-9811-0872e3f853a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:46.563831 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b52898-d8b2-4d17-9811-0872e3f853a6 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:46.576722 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 335/645] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:46.582088 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d799b3-e683-4fd5-92b8-7a03de3c8c3f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:46.685288 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d799b3-e683-4fd5-92b8-7a03de3c8c3f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:46.718313 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bef3cb-f450-4c85-8a85-834ccee1f45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:46.719109 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bef3cb-f450-4c85-8a85-834ccee1f45f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:46.719393 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bef3cb-f450-4c85-8a85-834ccee1f45f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:46.719669 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bef3cb-f450-4c85-8a85-834ccee1f45f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:46.728473 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bef3cb-f450-4c85-8a85-834ccee1f45f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:46.729937 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bef3cb-f450-4c85-8a85-834ccee1f45f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-e2bef3cb-f450-4c85-8a85-834ccee1f45f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:00:46.745474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:46.748264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:46.750517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:46.750517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:46.750517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:00:46.750517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:00:46.750517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:00:46.750517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:00:46.750517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:00:46.750517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:00:46.750517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 29 20:00:46.750517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:46.750517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 311/646] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Apr 29 20:00:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:46.752803 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b52898-d8b2-4d17-9811-0872e3f853a6 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:46.872963 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b52898-d8b2-4d17-9811-0872e3f853a6 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:46.908029 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369c930-73be-421f-9a52-5d43e022fd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:46.908717 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369c930-73be-421f-9a52-5d43e022fd11 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:46.908996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369c930-73be-421f-9a52-5d43e022fd11 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:46.909271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369c930-73be-421f-9a52-5d43e022fd11 None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:46.910108 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369c930-73be-421f-9a52-5d43e022fd11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:46.910412 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369c930-73be-421f-9a52-5d43e022fd11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:46.911846 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369c930-73be-421f-9a52-5d43e022fd11 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:46.930421 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 336/647] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Apr 29 20:00:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:46.936020 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bef3cb-f450-4c85-8a85-834ccee1f45f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:47.030115 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88654db1-ca12-4047-8c17-a6744504df15 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:47.030440 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88654db1-ca12-4047-8c17-a6744504df15 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:47.030661 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88654db1-ca12-4047-8c17-a6744504df15 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:47.032310 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 337/648] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:00:47.038667 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8ffe7-527e-4930-a55e-26afb1d45591 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:47.038949 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8ffe7-527e-4930-a55e-26afb1d45591 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:47.039229 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8ffe7-527e-4930-a55e-26afb1d45591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:47.039740 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bef3cb-f450-4c85-8a85-834ccee1f45f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:47.061050 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-4ab8ffe7-527e-4930-a55e-26afb1d45591 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:47.062542 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-4ab8ffe7-527e-4930-a55e-26afb1d45591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:47.074876 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd58827-a8d9-4bf0-828a-2d815b7cc9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:47.075624 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58827-a8d9-4bf0-828a-2d815b7cc9cd None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:47.075908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58827-a8d9-4bf0-828a-2d815b7cc9cd None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:47.076227 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58827-a8d9-4bf0-828a-2d815b7cc9cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:47.147528 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd58827-a8d9-4bf0-828a-2d815b7cc9cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:47.149372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd58827-a8d9-4bf0-828a-2d815b7cc9cd None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:47.153876 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 338/649] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 20:00:47.180078 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8ffe7-527e-4930-a55e-26afb1d45591 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:47.264581 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 312/650] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 29 20:00:47.266001 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd58827-a8d9-4bf0-828a-2d815b7cc9cd None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:47.310774 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8ffe7-527e-4930-a55e-26afb1d45591 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:47.348962 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab113593-2134-4298-83ef-c31b4b899d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:47.350028 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab113593-2134-4298-83ef-c31b4b899d59 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:47.350502 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab113593-2134-4298-83ef-c31b4b899d59 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:47.350943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab113593-2134-4298-83ef-c31b4b899d59 None admin] PATH_INFO: `/v3/services/image` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:47.351726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab113593-2134-4298-83ef-c31b4b899d59 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:47.353534 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab113593-2134-4298-83ef-c31b4b899d59 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-ab113593-2134-4298-83ef-c31b4b899d59 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:47.367569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:47.368866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:47.369845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:47.369845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:47.369845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:47.369845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:47.369845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:47.369845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:47.369845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:47.369845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:47.369845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:47.369845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:47.369845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:00:47.369845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:47.369845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 20:00:47.369845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:47.372298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 339/651] 10.222.0.58 () {56 vars in 1105 bytes} [Fri Apr 29 20:00:47 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:47.377646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab113593-2134-4298-83ef-c31b4b899d59 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:47.381821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd58827-a8d9-4bf0-828a-2d815b7cc9cd None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:47.423210 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb326ef-74a2-4c30-9c28-709cd3e36fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:47.424040 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb326ef-74a2-4c30-9c28-709cd3e36fb0 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:47.424328 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb326ef-74a2-4c30-9c28-709cd3e36fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:47.424604 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb326ef-74a2-4c30-9c28-709cd3e36fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:47.437120 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb326ef-74a2-4c30-9c28-709cd3e36fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:47.438873 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb326ef-74a2-4c30-9c28-709cd3e36fb0 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:47.461072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-6cb326ef-74a2-4c30-9c28-709cd3e36fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:47.461072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:47.461072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:47.461072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:47.461072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:47.461072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:47.461072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:47.461072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:47.461072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:47.461072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:47.461072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:47.461072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:47.461072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:47.461072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:47.461072 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:47.462055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:47.462953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:47.462953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:47.462953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:47.462953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:47.464559 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 313/652] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:47.465989 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab002d11-eef2-4175-b108-357530ee5389 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:47.466437 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab002d11-eef2-4175-b108-357530ee5389 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:47.466864 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab002d11-eef2-4175-b108-357530ee5389 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:47.468302 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 314/653] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:47.469775 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab002d11-eef2-4175-b108-357530ee5389 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:47.495225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab113593-2134-4298-83ef-c31b4b899d59 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:47.530902 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568829-e2a3-4c79-be2f-53bcd158e00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:47.531493 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568829-e2a3-4c79-be2f-53bcd158e00b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:47.531785 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568829-e2a3-4c79-be2f-53bcd158e00b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:47.532112 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568829-e2a3-4c79-be2f-53bcd158e00b None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:47.532810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568829-e2a3-4c79-be2f-53bcd158e00b None admin] RBAC: Adding query filter params (name=image) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:47.533107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568829-e2a3-4c79-be2f-53bcd158e00b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:47.534492 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568829-e2a3-4c79-be2f-53bcd158e00b None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:47.539221 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 340/654] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:47.540251 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5bd57-07b1-4985-b268-63b51d1053c1 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:47.540537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5bd57-07b1-4985-b268-63b51d1053c1 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:47.540813 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5bd57-07b1-4985-b268-63b51d1053c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:47.556631 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-62c5bd57-07b1-4985-b268-63b51d1053c1 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:47.557809 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-62c5bd57-07b1-4985-b268-63b51d1053c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:47.585215 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab002d11-eef2-4175-b108-357530ee5389 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:47.619596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492d626-57fa-496b-bdbf-3d5c9bbf088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:47.620447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492d626-57fa-496b-bdbf-3d5c9bbf088f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:47.620825 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492d626-57fa-496b-bdbf-3d5c9bbf088f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:47.621197 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492d626-57fa-496b-bdbf-3d5c9bbf088f None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:47.621993 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492d626-57fa-496b-bdbf-3d5c9bbf088f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:47.622370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492d626-57fa-496b-bdbf-3d5c9bbf088f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:47.628045 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 341/655] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:47.628045 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5bd57-07b1-4985-b268-63b51d1053c1 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:47.628283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492d626-57fa-496b-bdbf-3d5c9bbf088f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:47.643554 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 315/656] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:47.648741 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492d626-57fa-496b-bdbf-3d5c9bbf088f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:47.723105 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5bd57-07b1-4985-b268-63b51d1053c1 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:47.748388 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492d626-57fa-496b-bdbf-3d5c9bbf088f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:47.757333 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1f22c-546f-4f28-920f-86a774c5abe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:47.757985 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1f22c-546f-4f28-920f-86a774c5abe2 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:47.758262 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1f22c-546f-4f28-920f-86a774c5abe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:47.758535 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1f22c-546f-4f28-920f-86a774c5abe2 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:47.759226 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1f22c-546f-4f28-920f-86a774c5abe2 None admin] RBAC: Adding query filter params (type=image) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:47.759525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1f22c-546f-4f28-920f-86a774c5abe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:47.760934 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1f22c-546f-4f28-920f-86a774c5abe2 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:47.766153 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 342/657] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:47.766918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1f22c-546f-4f28-920f-86a774c5abe2 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:47.781502 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404282f-3402-4a55-ab74-d666ac8d04c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:47.782084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404282f-3402-4a55-ab74-d666ac8d04c2 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:47.782362 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404282f-3402-4a55-ab74-d666ac8d04c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:47.782631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404282f-3402-4a55-ab74-d666ac8d04c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:47.791273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404282f-3402-4a55-ab74-d666ac8d04c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:47.792780 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404282f-3402-4a55-ab74-d666ac8d04c2 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:47.808831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-a404282f-3402-4a55-ab74-d666ac8d04c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:47.808831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:47.808831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:47.808831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:47.808831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:47.808831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:47.808831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:47.808831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:47.808831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:47.808831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:47.808831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:47.808831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:47.808831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:00:47.808831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:00:47.808831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:47.809961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:47.811019 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:00:47.811019 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:00:47.811019 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:00:47.811019 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:00:47.811019 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:00:47.811019 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:00:47.811019 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:47.811019 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:47.811019 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 316/658] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:47.811605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c391aa7-a525-47b8-b484-9f36c34bd7bd None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:47.811605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c391aa7-a525-47b8-b484-9f36c34bd7bd None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:47.811877 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c391aa7-a525-47b8-b484-9f36c34bd7bd None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:47.816038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 317/659] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:47.817952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c391aa7-a525-47b8-b484-9f36c34bd7bd None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:47.888641 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1f22c-546f-4f28-920f-86a774c5abe2 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:47.924240 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b96ef-d41b-4208-aa7d-22746bb5be84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:47.924765 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c391aa7-a525-47b8-b484-9f36c34bd7bd None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:47.925624 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b96ef-d41b-4208-aa7d-22746bb5be84 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:47.926285 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b96ef-d41b-4208-aa7d-22746bb5be84 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:47.926749 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b96ef-d41b-4208-aa7d-22746bb5be84 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:47.928998 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b96ef-d41b-4208-aa7d-22746bb5be84 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:47.930618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b96ef-d41b-4208-aa7d-22746bb5be84 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-ac4b96ef-d41b-4208-aa7d-22746bb5be84 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:47.945186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:47.946389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:47.947428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:47.947428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:47.947428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:47.947428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:47.947428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:47.947428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:47.947428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:47.947428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:47.947428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:47.947428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:47.947428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:47.947428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:00:47.947428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:47.947428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 20:00:47.947428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:47.949744 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 343/660] 10.222.0.58 () {56 vars in 1129 bytes} [Fri Apr 29 20:00:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:47.951196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32d2f8-9d9c-4412-af1f-83523b1073bc None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:47.951618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32d2f8-9d9c-4412-af1f-83523b1073bc None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:47.952055 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32d2f8-9d9c-4412-af1f-83523b1073bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:47.960916 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455ed68-0552-4d74-978c-aa8960ea6c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:47.961430 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455ed68-0552-4d74-978c-aa8960ea6c6d None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:47.961765 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455ed68-0552-4d74-978c-aa8960ea6c6d None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:47.962109 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455ed68-0552-4d74-978c-aa8960ea6c6d None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:47.963141 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455ed68-0552-4d74-978c-aa8960ea6c6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:47.963247 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455ed68-0552-4d74-978c-aa8960ea6c6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:47.965038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455ed68-0552-4d74-978c-aa8960ea6c6d None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:47.972678 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-ce32d2f8-9d9c-4412-af1f-83523b1073bc None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:47.973857 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-ce32d2f8-9d9c-4412-af1f-83523b1073bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:47.980098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 318/661] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:00:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:47.980098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455ed68-0552-4d74-978c-aa8960ea6c6d None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:48.043923 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 344/662] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:48.045123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32d2f8-9d9c-4412-af1f-83523b1073bc None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:48.089748 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455ed68-0552-4d74-978c-aa8960ea6c6d None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:48.125205 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9543f3-83eb-4889-b452-44603a8c9c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:48.125874 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9543f3-83eb-4889-b452-44603a8c9c9c None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:48.126181 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9543f3-83eb-4889-b452-44603a8c9c9c None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:48.126462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9543f3-83eb-4889-b452-44603a8c9c9c None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:48.127128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9543f3-83eb-4889-b452-44603a8c9c9c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:48.127435 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9543f3-83eb-4889-b452-44603a8c9c9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:48.128831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9543f3-83eb-4889-b452-44603a8c9c9c None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:48.137684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 319/663] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Apr 29 20:00:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:48.137684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9543f3-83eb-4889-b452-44603a8c9c9c None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:48.150822 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32d2f8-9d9c-4412-af1f-83523b1073bc None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:48.187473 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3cc01-9caa-4203-97e5-5b90834aca9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:48.188239 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3cc01-9caa-4203-97e5-5b90834aca9f None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:48.198920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3cc01-9caa-4203-97e5-5b90834aca9f None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:48.198920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3cc01-9caa-4203-97e5-5b90834aca9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:48.198920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3cc01-9caa-4203-97e5-5b90834aca9f None admin] RBAC: Adding query filter params (role.id=5255ed3fa613448fb4c549f5bc7f20af, scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c, user.id=ca4e798ccd784e348136af337bf780f6) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:48.198920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3cc01-9caa-4203-97e5-5b90834aca9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:48.198920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3cc01-9caa-4203-97e5-5b90834aca9f None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:48.199409 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 345/664] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:00:48 2022] GET /identity/v3/role_assignments?user.id=ca4e798ccd784e348136af337bf780f6&scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c&role.id=5255ed3fa613448fb4c549f5bc7f20af => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:48.199409 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3cc01-9caa-4203-97e5-5b90834aca9f None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:48.260319 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9543f3-83eb-4889-b452-44603a8c9c9c None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:48.306971 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020d2ae-d778-4ab7-bcca-db977d868dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:48.307166 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3cc01-9caa-4203-97e5-5b90834aca9f None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:48.308292 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020d2ae-d778-4ab7-bcca-db977d868dea None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:48.308927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020d2ae-d778-4ab7-bcca-db977d868dea None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:48.310396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020d2ae-d778-4ab7-bcca-db977d868dea None admin] PATH_INFO: `/v3/services/network` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:48.311282 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020d2ae-d778-4ab7-bcca-db977d868dea None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:48.312892 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020d2ae-d778-4ab7-bcca-db977d868dea None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-4020d2ae-d778-4ab7-bcca-db977d868dea None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:48.332751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:48.333830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:48.334757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:48.334757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:48.334757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:48.334757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:48.334757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:48.334757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:48.334757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:48.334757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:48.334757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:48.334757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:48.334757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:00:48.334757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:48.334757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 20:00:48.334757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:48.337748 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 320/665] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:48 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:48.347051 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020d2ae-d778-4ab7-bcca-db977d868dea None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:48.349715 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f4b22-de0d-49cc-8cc5-a1f6a6e986e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:48.351033 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f4b22-de0d-49cc-8cc5-a1f6a6e986e5 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:48.351412 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f4b22-de0d-49cc-8cc5-a1f6a6e986e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:48.351788 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f4b22-de0d-49cc-8cc5-a1f6a6e986e5 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:48.352656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f4b22-de0d-49cc-8cc5-a1f6a6e986e5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:48.353020 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f4b22-de0d-49cc-8cc5-a1f6a6e986e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:48.354763 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f4b22-de0d-49cc-8cc5-a1f6a6e986e5 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:48.364079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 346/666] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Apr 29 20:00:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:48.473971 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020d2ae-d778-4ab7-bcca-db977d868dea None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:48.510311 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed11c8d-3620-4171-b8eb-b02e5887a5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:48.511020 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed11c8d-3620-4171-b8eb-b02e5887a5ab None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:48.511307 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed11c8d-3620-4171-b8eb-b02e5887a5ab None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:48.511574 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed11c8d-3620-4171-b8eb-b02e5887a5ab None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:48.512319 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed11c8d-3620-4171-b8eb-b02e5887a5ab None admin] RBAC: Adding query filter params (name=network) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:48.512620 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed11c8d-3620-4171-b8eb-b02e5887a5ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:48.514014 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed11c8d-3620-4171-b8eb-b02e5887a5ab None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:48.521295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 321/667] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Apr 29 20:00:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:48.526713 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f4b22-de0d-49cc-8cc5-a1f6a6e986e5 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:48.633671 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f4b22-de0d-49cc-8cc5-a1f6a6e986e5 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:48.667523 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0571434-98db-4675-97c1-c1308d6bfdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:48.668210 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0571434-98db-4675-97c1-c1308d6bfdd0 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:48.668489 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0571434-98db-4675-97c1-c1308d6bfdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:48.668762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0571434-98db-4675-97c1-c1308d6bfdd0 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:48.669463 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0571434-98db-4675-97c1-c1308d6bfdd0 None admin] RBAC: Adding query filter params (type=network) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:48.669765 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0571434-98db-4675-97c1-c1308d6bfdd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:48.671146 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0571434-98db-4675-97c1-c1308d6bfdd0 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:48.675852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 347/668] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Apr 29 20:00:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:50.133335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7e24c-75c3-41d8-a925-5caba79f158d None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:50.133908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7e24c-75c3-41d8-a925-5caba79f158d None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:50.133908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7e24c-75c3-41d8-a925-5caba79f158d None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:50.135492 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 322/669] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:50.141088 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f60653-d4d8-421d-a609-ec33775a8cee None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:50.141501 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f60653-d4d8-421d-a609-ec33775a8cee None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:50.141639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f60653-d4d8-421d-a609-ec33775a8cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:50.159561 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-43f60653-d4d8-421d-a609-ec33775a8cee None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:50.160779 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-43f60653-d4d8-421d-a609-ec33775a8cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:50.232091 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 348/670] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:50.251669 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7e24c-75c3-41d8-a925-5caba79f158d None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:50.358066 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7e24c-75c3-41d8-a925-5caba79f158d None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:50.392508 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c01534-292a-4941-9929-e6b4ff8b9e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:50.393093 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01534-292a-4941-9929-e6b4ff8b9e07 None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:50.393377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01534-292a-4941-9929-e6b4ff8b9e07 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:50.393654 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01534-292a-4941-9929-e6b4ff8b9e07 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:50.394376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c01534-292a-4941-9929-e6b4ff8b9e07 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:50.395740 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c01534-292a-4941-9929-e6b4ff8b9e07 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:50.512130 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 323/671] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Apr 29 20:00:50 2022] POST /identity/v3/services => generated 242 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:00:50.636955 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92453d85-88ef-4ef4-ab88-5a446f52d0fa None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:50.637369 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92453d85-88ef-4ef4-ab88-5a446f52d0fa None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:50.637549 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92453d85-88ef-4ef4-ab88-5a446f52d0fa None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:50.639298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 349/672] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:50.645617 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399a702-eb87-457d-9a49-8829502f3a1a None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:50.645907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399a702-eb87-457d-9a49-8829502f3a1a None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:50.646087 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399a702-eb87-457d-9a49-8829502f3a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:50.666527 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-c399a702-eb87-457d-9a49-8829502f3a1a None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:50.667904 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-c399a702-eb87-457d-9a49-8829502f3a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:50.759141 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 324/673] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:50 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:50.783963 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92453d85-88ef-4ef4-ab88-5a446f52d0fa None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:50.837952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deff91-5fd7-43c4-846d-a9102f70a8f2 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:50.838593 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deff91-5fd7-43c4-846d-a9102f70a8f2 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:50.839069 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deff91-5fd7-43c4-846d-a9102f70a8f2 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:50.840675 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 325/674] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:00:50.846070 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd61882-9d59-4e09-a3a5-cc1d316f6ea2 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:50.846344 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd61882-9d59-4e09-a3a5-cc1d316f6ea2 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:50.846620 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd61882-9d59-4e09-a3a5-cc1d316f6ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:50.867879 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-9bd61882-9d59-4e09-a3a5-cc1d316f6ea2 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:50.869204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-9bd61882-9d59-4e09-a3a5-cc1d316f6ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:50.895717 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92453d85-88ef-4ef4-ab88-5a446f52d0fa None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:50.945677 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e35141-6e89-4cf8-85eb-6ba274346603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:50.946913 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e35141-6e89-4cf8-85eb-6ba274346603 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:50.947400 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e35141-6e89-4cf8-85eb-6ba274346603 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:50.947888 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e35141-6e89-4cf8-85eb-6ba274346603 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:50.963239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 326/675] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:50 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 29 20:00:50.963472 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e35141-6e89-4cf8-85eb-6ba274346603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-66e35141-6e89-4cf8-85eb-6ba274346603 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:50.970810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:50.971775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:50.972656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:50.972656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:50.972656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:50.972656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:50.972656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:50.972656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:50.972656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:50.972656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:50.972656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:50.972656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:50.972656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:00:50.972656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:50.972656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 350/676] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 20:00:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:50.978965 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd61882-9d59-4e09-a3a5-cc1d316f6ea2 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:50.985052 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e35141-6e89-4cf8-85eb-6ba274346603 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:51.087204 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e35141-6e89-4cf8-85eb-6ba274346603 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:51.106400 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd61882-9d59-4e09-a3a5-cc1d316f6ea2 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:51.123144 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4de5c-091c-46da-8392-daaaeceb35b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:51.124189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4de5c-091c-46da-8392-daaaeceb35b9 None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:51.124704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4de5c-091c-46da-8392-daaaeceb35b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:51.125203 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4de5c-091c-46da-8392-daaaeceb35b9 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:51.126177 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4de5c-091c-46da-8392-daaaeceb35b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:51.127761 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4de5c-091c-46da-8392-daaaeceb35b9 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:51.145466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee53475-3392-4ec5-9971-cfd0925888de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:51.146389 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee53475-3392-4ec5-9971-cfd0925888de None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:51.146655 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee53475-3392-4ec5-9971-cfd0925888de None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:51.146929 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee53475-3392-4ec5-9971-cfd0925888de None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:51.147962 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee53475-3392-4ec5-9971-cfd0925888de None admin] RBAC: Adding query filter params (name=admin) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:51.148521 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee53475-3392-4ec5-9971-cfd0925888de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:51.149905 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee53475-3392-4ec5-9971-cfd0925888de None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:51.158201 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 327/677] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:51.159433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d3d06-65f2-4376-a887-f30c9bfa16b2 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:51.159776 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d3d06-65f2-4376-a887-f30c9bfa16b2 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:51.159998 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d3d06-65f2-4376-a887-f30c9bfa16b2 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:51.163933 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 328/678] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:51.164143 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d3d06-65f2-4376-a887-f30c9bfa16b2 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:51.206299 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 351/679] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Apr 29 20:00:50 2022] POST /identity/v3/services => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:00:51.208337 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598535ab-0b88-4acf-b6a7-ae56c76ca796 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:51.208694 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598535ab-0b88-4acf-b6a7-ae56c76ca796 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:51.209279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598535ab-0b88-4acf-b6a7-ae56c76ca796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:51.230948 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-598535ab-0b88-4acf-b6a7-ae56c76ca796 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:51.232861 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-598535ab-0b88-4acf-b6a7-ae56c76ca796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:51.302493 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d3d06-65f2-4376-a887-f30c9bfa16b2 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:51.324019 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 352/680] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:51 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 29 20:00:51.352244 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598535ab-0b88-4acf-b6a7-ae56c76ca796 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:51.355583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804e5b7-feb7-4b44-bf46-1f57cded76c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:51.356776 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804e5b7-feb7-4b44-bf46-1f57cded76c3 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:51.357256 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804e5b7-feb7-4b44-bf46-1f57cded76c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:51.357967 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804e5b7-feb7-4b44-bf46-1f57cded76c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:51.372607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804e5b7-feb7-4b44-bf46-1f57cded76c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:51.375113 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804e5b7-feb7-4b44-bf46-1f57cded76c3 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:51.482660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598535ab-0b88-4acf-b6a7-ae56c76ca796 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:51.518682 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66024ca-f456-42e6-8b79-6265d8b6b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:51.519351 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66024ca-f456-42e6-8b79-6265d8b6b587 None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:51.519632 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66024ca-f456-42e6-8b79-6265d8b6b587 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:51.519902 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66024ca-f456-42e6-8b79-6265d8b6b587 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:51.520652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66024ca-f456-42e6-8b79-6265d8b6b587 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:51.522633 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66024ca-f456-42e6-8b79-6265d8b6b587 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:51.523160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-6804e5b7-feb7-4b44-bf46-1f57cded76c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:51.523160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:51.523160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:51.523160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:51.523160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:51.523160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:51.523160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:51.523160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:51.523160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:51.523160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:51.523160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:51.523160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:51.523160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:51.523160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:51.523160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:51.524043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:51.524952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:51.524952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:51.524952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:51.524952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:51.526899 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 329/681] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:51.532694 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804e5b7-feb7-4b44-bf46-1f57cded76c3 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:51.633603 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804e5b7-feb7-4b44-bf46-1f57cded76c3 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:51.637886 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 353/682] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Apr 29 20:00:51 2022] POST /identity/v3/services => generated 240 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:00:51.683234 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43612769-4d7b-4c48-9ff0-b3fc2286932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:51.684405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43612769-4d7b-4c48-9ff0-b3fc2286932e None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:51.684934 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43612769-4d7b-4c48-9ff0-b3fc2286932e None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:51.685438 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43612769-4d7b-4c48-9ff0-b3fc2286932e None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:51.686422 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43612769-4d7b-4c48-9ff0-b3fc2286932e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:51.686936 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43612769-4d7b-4c48-9ff0-b3fc2286932e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:51.688626 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43612769-4d7b-4c48-9ff0-b3fc2286932e None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:51.703349 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 330/683] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:51.708597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66024ca-f456-42e6-8b79-6265d8b6b587 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:51.823144 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66024ca-f456-42e6-8b79-6265d8b6b587 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:51.858231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac78f21-1f86-4c2d-a88b-11710bfe9f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:51.859348 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac78f21-1f86-4c2d-a88b-11710bfe9f9f None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:51.859864 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac78f21-1f86-4c2d-a88b-11710bfe9f9f None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:51.860353 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac78f21-1f86-4c2d-a88b-11710bfe9f9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:51.869174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac78f21-1f86-4c2d-a88b-11710bfe9f9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:51.870795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac78f21-1f86-4c2d-a88b-11710bfe9f9f None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-0ac78f21-1f86-4c2d-a88b-11710bfe9f9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:00:51.884977 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:51.889461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:51.890413 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:51.890413 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:51.890413 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:00:51.890413 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:00:51.890413 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:00:51.890413 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:00:51.890413 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:00:51.890413 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:00:51.890413 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 29 20:00:51.890413 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:51.890413 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 354/684] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Apr 29 20:00:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:51.891825 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43612769-4d7b-4c48-9ff0-b3fc2286932e None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:51.998494 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43612769-4d7b-4c48-9ff0-b3fc2286932e None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:52.032751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dfcb7-b4a8-4e04-bb35-01351b34bdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:52.033418 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dfcb7-b4a8-4e04-bb35-01351b34bdae None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:52.033701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dfcb7-b4a8-4e04-bb35-01351b34bdae None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:52.033968 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dfcb7-b4a8-4e04-bb35-01351b34bdae None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:52.034807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dfcb7-b4a8-4e04-bb35-01351b34bdae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:52.035113 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dfcb7-b4a8-4e04-bb35-01351b34bdae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:52.036591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dfcb7-b4a8-4e04-bb35-01351b34bdae None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:52.055571 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 331/685] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Apr 29 20:00:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:52.061226 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac78f21-1f86-4c2d-a88b-11710bfe9f9f None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:52.167040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac78f21-1f86-4c2d-a88b-11710bfe9f9f None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:52.200025 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3bb3a-557a-4866-94fa-3fd78e82d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:52.200824 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3bb3a-557a-4866-94fa-3fd78e82d842 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:52.201104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3bb3a-557a-4866-94fa-3fd78e82d842 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:52.201377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3bb3a-557a-4866-94fa-3fd78e82d842 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:52.212404 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3bb3a-557a-4866-94fa-3fd78e82d842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:52.213863 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3bb3a-557a-4866-94fa-3fd78e82d842 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:52.231551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-7ef3bb3a-557a-4866-94fa-3fd78e82d842 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:52.231551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:52.231551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:52.231551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:52.231551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:52.231551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:52.231551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:52.231551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:52.231551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:52.231551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:52.231551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:52.231551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:52.231551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:52.231551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:52.231551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:52.232537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:52.233416 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:52.233416 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:52.233416 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:52.233416 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:52.233416 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 355/686] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:52.238534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dfcb7-b4a8-4e04-bb35-01351b34bdae None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:52.340699 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dfcb7-b4a8-4e04-bb35-01351b34bdae None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:52.376344 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762b262-0862-448e-93ab-cdefad83c698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:52.377160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762b262-0862-448e-93ab-cdefad83c698 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:52.377540 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762b262-0862-448e-93ab-cdefad83c698 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:52.377938 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762b262-0862-448e-93ab-cdefad83c698 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:52.378740 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762b262-0862-448e-93ab-cdefad83c698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:52.379148 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762b262-0862-448e-93ab-cdefad83c698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:52.380659 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762b262-0862-448e-93ab-cdefad83c698 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:52.392364 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 332/687] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:52.401055 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3bb3a-557a-4866-94fa-3fd78e82d842 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:52.508536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3bb3a-557a-4866-94fa-3fd78e82d842 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:52.542304 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53540806-d95f-4962-95d4-b2ecfb9eb4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:52.543103 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53540806-d95f-4962-95d4-b2ecfb9eb4da None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:52.543380 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53540806-d95f-4962-95d4-b2ecfb9eb4da None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:52.543649 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53540806-d95f-4962-95d4-b2ecfb9eb4da None admin] PATH_INFO: `/v3/projects/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:52.550430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53540806-d95f-4962-95d4-b2ecfb9eb4da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:52.551926 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53540806-d95f-4962-95d4-b2ecfb9eb4da None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:52.566195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-53540806-d95f-4962-95d4-b2ecfb9eb4da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:52.566195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:52.566195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:52.566195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:52.566195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:52.566195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:52.566195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:52.566195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:52.566195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:52.566195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:52.566195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:52.566195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:52.566195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:00:52.566195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:00:52.566195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:52.567186 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:52.568106 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:00:52.568106 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:00:52.568106 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:00:52.568106 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:00:52.568106 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:00:52.568106 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:00:52.568106 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:52.568106 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:52.568106 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 356/688] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:52.575348 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762b262-0862-448e-93ab-cdefad83c698 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:52.676063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762b262-0862-448e-93ab-cdefad83c698 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:52.709623 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13083950-66a1-4775-a77a-6669dc960b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:52.710286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13083950-66a1-4775-a77a-6669dc960b26 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:52.710562 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13083950-66a1-4775-a77a-6669dc960b26 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:52.710832 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13083950-66a1-4775-a77a-6669dc960b26 None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:52.711611 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13083950-66a1-4775-a77a-6669dc960b26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:52.711914 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13083950-66a1-4775-a77a-6669dc960b26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:52.713377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13083950-66a1-4775-a77a-6669dc960b26 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:52.726137 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 333/689] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:00:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:52.733033 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53540806-d95f-4962-95d4-b2ecfb9eb4da None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:52.836263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53540806-d95f-4962-95d4-b2ecfb9eb4da None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:52.870613 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640d0bf-ca90-4a9f-8212-a044c699ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:52.871870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640d0bf-ca90-4a9f-8212-a044c699ceb6 None admin] REQUEST_METHOD: `PUT` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:52.872478 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640d0bf-ca90-4a9f-8212-a044c699ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:52.873043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640d0bf-ca90-4a9f-8212-a044c699ceb6 None admin] PATH_INFO: `/v3/projects/d13e73e4e3bf4143b30c02ccf7e1a13c/users/ca4e798ccd784e348136af337bf780f6/roles/5255ed3fa613448fb4c549f5bc7f20af` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:52.875286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640d0bf-ca90-4a9f-8212-a044c699ceb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d13e73e4e3bf4143b30c02ccf7e1a13c, user_id=ca4e798ccd784e348136af337bf780f6, role_id=5255ed3fa613448fb4c549f5bc7f20af)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:52.877060 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640d0bf-ca90-4a9f-8212-a044c699ceb6 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:52.938677 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa351c-a8af-464c-8b8e-5cbeb85deef9 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:52.938983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa351c-a8af-464c-8b8e-5cbeb85deef9 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:52.939217 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa351c-a8af-464c-8b8e-5cbeb85deef9 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:52.940734 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 334/690] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:00:52.946046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78c2e1-1e39-467a-afe1-72c8b26b5e73 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:52.946324 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78c2e1-1e39-467a-afe1-72c8b26b5e73 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:52.946596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78c2e1-1e39-467a-afe1-72c8b26b5e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:52.950978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 357/691] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 20:00:52 2022] PUT /identity/v3/projects/d13e73e4e3bf4143b30c02ccf7e1a13c/users/ca4e798ccd784e348136af337bf780f6/roles/5255ed3fa613448fb4c549f5bc7f20af => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:00:52.964315 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-3d78c2e1-1e39-467a-afe1-72c8b26b5e73 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:52.965726 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-3d78c2e1-1e39-467a-afe1-72c8b26b5e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:53.044968 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 335/692] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:00:53.069603 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640d0bf-ca90-4a9f-8212-a044c699ceb6 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:53.176226 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640d0bf-ca90-4a9f-8212-a044c699ceb6 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:53.212564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926fd0c-1865-42af-954b-d1692883940e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:53.214163 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926fd0c-1865-42af-954b-d1692883940e None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:53.214646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926fd0c-1865-42af-954b-d1692883940e None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:53.215136 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926fd0c-1865-42af-954b-d1692883940e None admin] PATH_INFO: `/v3/services/image` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:53.216021 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926fd0c-1865-42af-954b-d1692883940e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:53.217598 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926fd0c-1865-42af-954b-d1692883940e None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-c926fd0c-1865-42af-954b-d1692883940e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:53.229858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:53.230883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:53.231731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:53.231731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:53.231731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:53.231731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:53.231731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:53.231731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:53.231731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:53.231731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:53.231731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:53.231731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:53.231731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:00:53.231731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:53.231731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 20:00:53.231731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:53.234644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 358/693] 10.222.0.58 () {56 vars in 1105 bytes} [Fri Apr 29 20:00:53 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:53.240889 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78c2e1-1e39-467a-afe1-72c8b26b5e73 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:53.343054 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78c2e1-1e39-467a-afe1-72c8b26b5e73 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:53.377649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb618d-2b56-45d5-987c-438e89de6119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:53.378317 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb618d-2b56-45d5-987c-438e89de6119 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:53.378595 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb618d-2b56-45d5-987c-438e89de6119 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:53.378867 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb618d-2b56-45d5-987c-438e89de6119 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:53.379565 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb618d-2b56-45d5-987c-438e89de6119 None admin] RBAC: Adding query filter params (name=image) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:53.379865 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb618d-2b56-45d5-987c-438e89de6119 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:53.381298 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb618d-2b56-45d5-987c-438e89de6119 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:53.386201 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 336/694] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:53.392741 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926fd0c-1865-42af-954b-d1692883940e None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:53.503752 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926fd0c-1865-42af-954b-d1692883940e None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:53.537703 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09f159-aaf8-472b-9514-aad42efaea35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:53.538301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09f159-aaf8-472b-9514-aad42efaea35 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:53.538621 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09f159-aaf8-472b-9514-aad42efaea35 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:53.538899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09f159-aaf8-472b-9514-aad42efaea35 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:53.539595 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09f159-aaf8-472b-9514-aad42efaea35 None admin] RBAC: Adding query filter params (type=image) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:53.539894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09f159-aaf8-472b-9514-aad42efaea35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:53.541315 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09f159-aaf8-472b-9514-aad42efaea35 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:53.546383 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 359/695] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:53.551955 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb618d-2b56-45d5-987c-438e89de6119 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:53.652340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb618d-2b56-45d5-987c-438e89de6119 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:53.663203 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cfc16-eb32-4b36-940a-b440706be74c None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:53.663490 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cfc16-eb32-4b36-940a-b440706be74c None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:53.663768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cfc16-eb32-4b36-940a-b440706be74c None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:53.665389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 360/696] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:53.671589 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1f03b-9d10-4549-a16a-a2bc759b1e35 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:53.671872 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1f03b-9d10-4549-a16a-a2bc759b1e35 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:53.672173 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1f03b-9d10-4549-a16a-a2bc759b1e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:53.690394 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e53a75-4517-4077-b3e9-da8cad4d4246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:53.691056 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e53a75-4517-4077-b3e9-da8cad4d4246 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:53.691334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e53a75-4517-4077-b3e9-da8cad4d4246 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:53.691609 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e53a75-4517-4077-b3e9-da8cad4d4246 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:53.692179 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-93d1f03b-9d10-4549-a16a-a2bc759b1e35 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:53.692428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e53a75-4517-4077-b3e9-da8cad4d4246 None admin] RBAC: Adding query filter params (interface=public, service_id=56d2c0f41f7d4db2a06cde214ae5978f, region_id=RegionOne) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:53.692738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e53a75-4517-4077-b3e9-da8cad4d4246 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:53.693386 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-93d1f03b-9d10-4549-a16a-a2bc759b1e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:53.694136 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e53a75-4517-4077-b3e9-da8cad4d4246 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:53.703513 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 337/697] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Apr 29 20:00:53 2022] GET /identity/v3/endpoints?service_id=56d2c0f41f7d4db2a06cde214ae5978f&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:53.709621 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e53a75-4517-4077-b3e9-da8cad4d4246 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:53.784649 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 361/698] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:53 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 20:00:53.808800 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1f03b-9d10-4549-a16a-a2bc759b1e35 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:53.840299 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e53a75-4517-4077-b3e9-da8cad4d4246 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:53.875855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36335106-58f2-452a-814a-f8543a17b3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:53.876558 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36335106-58f2-452a-814a-f8543a17b3cb None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:53.876834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36335106-58f2-452a-814a-f8543a17b3cb None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:53.877107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36335106-58f2-452a-814a-f8543a17b3cb None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:53.877776 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36335106-58f2-452a-814a-f8543a17b3cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:53.879152 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36335106-58f2-452a-814a-f8543a17b3cb None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:53.885508 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 338/699] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Apr 29 20:00:53 2022] GET /identity/v3/services => generated 1002 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 20:00:53.915634 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1f03b-9d10-4549-a16a-a2bc759b1e35 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:53.952828 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef48a1a-7cdd-4c1b-b3fa-75891f609e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:53.953670 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef48a1a-7cdd-4c1b-b3fa-75891f609e2a None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:53.953950 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef48a1a-7cdd-4c1b-b3fa-75891f609e2a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:53.954224 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef48a1a-7cdd-4c1b-b3fa-75891f609e2a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:53.954885 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef48a1a-7cdd-4c1b-b3fa-75891f609e2a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:53.956375 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef48a1a-7cdd-4c1b-b3fa-75891f609e2a None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-9ef48a1a-7cdd-4c1b-b3fa-75891f609e2a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:53.970468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:53.972683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:53.974704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 362/700] 10.222.0.58 () {56 vars in 1129 bytes} [Fri Apr 29 20:00:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:53.980156 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36335106-58f2-452a-814a-f8543a17b3cb None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:54.090323 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36335106-58f2-452a-814a-f8543a17b3cb None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:54.127213 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30da983-8864-47f2-b6c3-328cac71adb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:54.127884 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30da983-8864-47f2-b6c3-328cac71adb1 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:54.128198 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30da983-8864-47f2-b6c3-328cac71adb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:54.128473 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30da983-8864-47f2-b6c3-328cac71adb1 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:54.129174 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30da983-8864-47f2-b6c3-328cac71adb1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:54.129475 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30da983-8864-47f2-b6c3-328cac71adb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:54.131354 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30da983-8864-47f2-b6c3-328cac71adb1 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:54.136370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 339/701] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Apr 29 20:00:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:54.141522 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef48a1a-7cdd-4c1b-b3fa-75891f609e2a None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:54.244311 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef48a1a-7cdd-4c1b-b3fa-75891f609e2a None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:54.283518 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337edef9-6e80-4169-997c-1467782e33a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:54.284214 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337edef9-6e80-4169-997c-1467782e33a8 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:54.284497 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337edef9-6e80-4169-997c-1467782e33a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:54.284769 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337edef9-6e80-4169-997c-1467782e33a8 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:54.285480 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337edef9-6e80-4169-997c-1467782e33a8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:54.285787 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337edef9-6e80-4169-997c-1467782e33a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:54.287232 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337edef9-6e80-4169-997c-1467782e33a8 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:54.287439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bba58-3004-4806-ba46-332ad97c2a2d None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:54.287868 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bba58-3004-4806-ba46-332ad97c2a2d None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:54.288080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bba58-3004-4806-ba46-332ad97c2a2d None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:54.289448 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 340/702] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:54.292765 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 363/703] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Apr 29 20:00:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:54.298460 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617705b-cec9-46cb-809c-509ed7a2d2eb None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:54.298750 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617705b-cec9-46cb-809c-509ed7a2d2eb None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:54.299026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617705b-cec9-46cb-809c-509ed7a2d2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:54.301357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337edef9-6e80-4169-997c-1467782e33a8 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:54.317503 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-d617705b-cec9-46cb-809c-509ed7a2d2eb None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:54.319661 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-d617705b-cec9-46cb-809c-509ed7a2d2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:54.416261 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 341/704] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:54 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:00:54.426336 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337edef9-6e80-4169-997c-1467782e33a8 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:54.434595 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617705b-cec9-46cb-809c-509ed7a2d2eb None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:54.471263 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109e2fd-0b1e-4279-bd02-cba07cb38fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:54.472761 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109e2fd-0b1e-4279-bd02-cba07cb38fe5 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:54.473255 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109e2fd-0b1e-4279-bd02-cba07cb38fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:54.474111 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109e2fd-0b1e-4279-bd02-cba07cb38fe5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:54.475733 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109e2fd-0b1e-4279-bd02-cba07cb38fe5 None admin] RBAC: Adding query filter params (interface=public, service_id=1543bb0465364fb4829a4cf448937171, region_id=RegionOne) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:54.476395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109e2fd-0b1e-4279-bd02-cba07cb38fe5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:54.477832 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109e2fd-0b1e-4279-bd02-cba07cb38fe5 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:54.490104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 364/705] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Apr 29 20:00:54 2022] GET /identity/v3/endpoints?service_id=1543bb0465364fb4829a4cf448937171&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:54.492229 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109e2fd-0b1e-4279-bd02-cba07cb38fe5 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:54.550998 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617705b-cec9-46cb-809c-509ed7a2d2eb None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:54.592257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14befc2-d969-4d1a-b92b-4036a534d75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:54.593404 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14befc2-d969-4d1a-b92b-4036a534d75b None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:54.593638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109e2fd-0b1e-4279-bd02-cba07cb38fe5 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:54.594133 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14befc2-d969-4d1a-b92b-4036a534d75b None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:54.594610 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14befc2-d969-4d1a-b92b-4036a534d75b None admin] PATH_INFO: `/v3/services/network` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:54.595683 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14befc2-d969-4d1a-b92b-4036a534d75b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:54.597943 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14befc2-d969-4d1a-b92b-4036a534d75b None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-f14befc2-d969-4d1a-b92b-4036a534d75b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:54.612964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:54.614166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:54.615718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:54.615718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:54.615718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:54.615718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:54.615718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:54.615718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:54.615718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:54.615718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:54.615718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:54.615718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:54.615718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:00:54.615718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:54.615718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 20:00:54.615718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:54.618870 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 342/706] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:54 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:54.625253 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14befc2-d969-4d1a-b92b-4036a534d75b None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:54.636616 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b37516-f2ea-467a-a61a-1bd725e25a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:54.637360 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b37516-f2ea-467a-a61a-1bd725e25a07 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:54.638078 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b37516-f2ea-467a-a61a-1bd725e25a07 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:54.638078 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b37516-f2ea-467a-a61a-1bd725e25a07 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:54.638717 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b37516-f2ea-467a-a61a-1bd725e25a07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:54.640511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b37516-f2ea-467a-a61a-1bd725e25a07 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:54.652679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 365/707] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Apr 29 20:00:54 2022] GET /identity/v3/services => generated 1002 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 20:00:54.745466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14befc2-d969-4d1a-b92b-4036a534d75b None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:54.780892 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caac63a-76cd-426a-b668-7eab598514ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:54.781560 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caac63a-76cd-426a-b668-7eab598514ab None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:54.781836 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caac63a-76cd-426a-b668-7eab598514ab None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:54.782107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caac63a-76cd-426a-b668-7eab598514ab None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:54.782807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caac63a-76cd-426a-b668-7eab598514ab None admin] RBAC: Adding query filter params (name=network) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:54.783106 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caac63a-76cd-426a-b668-7eab598514ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:54.784592 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caac63a-76cd-426a-b668-7eab598514ab None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:54.790486 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 343/708] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Apr 29 20:00:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:54.795926 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b37516-f2ea-467a-a61a-1bd725e25a07 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:54.910373 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b37516-f2ea-467a-a61a-1bd725e25a07 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:54.944394 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc8ab7-0df1-4288-8e97-0631b208a0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:54.945438 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc8ab7-0df1-4288-8e97-0631b208a0d8 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:54.945933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc8ab7-0df1-4288-8e97-0631b208a0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:54.946502 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc8ab7-0df1-4288-8e97-0631b208a0d8 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:54.947415 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc8ab7-0df1-4288-8e97-0631b208a0d8 None admin] RBAC: Adding query filter params (type=network) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:54.947920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc8ab7-0df1-4288-8e97-0631b208a0d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:54.949596 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc8ab7-0df1-4288-8e97-0631b208a0d8 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:54.955059 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 366/709] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Apr 29 20:00:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:54.963589 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caac63a-76cd-426a-b668-7eab598514ab None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:55.062536 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caac63a-76cd-426a-b668-7eab598514ab None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:55.095238 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388be12d-c172-4a50-87c2-6c5157a44816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:55.096061 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388be12d-c172-4a50-87c2-6c5157a44816 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:55.096346 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388be12d-c172-4a50-87c2-6c5157a44816 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:55.096645 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388be12d-c172-4a50-87c2-6c5157a44816 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:55.097476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388be12d-c172-4a50-87c2-6c5157a44816 None admin] RBAC: Adding query filter params (interface=public, service_id=c2d3d1109bb94a9eaa3488eae4a3e320, region_id=RegionOne) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:55.097792 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388be12d-c172-4a50-87c2-6c5157a44816 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:55.099164 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388be12d-c172-4a50-87c2-6c5157a44816 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:55.105686 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 344/710] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Apr 29 20:00:54 2022] GET /identity/v3/endpoints?service_id=c2d3d1109bb94a9eaa3488eae4a3e320&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:55.111275 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc8ab7-0df1-4288-8e97-0631b208a0d8 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:55.213079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc8ab7-0df1-4288-8e97-0631b208a0d8 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:55.246529 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fca6b5-3421-4db5-a581-82b59f3db654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:55.247183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fca6b5-3421-4db5-a581-82b59f3db654 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:55.247455 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fca6b5-3421-4db5-a581-82b59f3db654 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:55.247719 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fca6b5-3421-4db5-a581-82b59f3db654 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:55.248414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fca6b5-3421-4db5-a581-82b59f3db654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:55.249773 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fca6b5-3421-4db5-a581-82b59f3db654 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:55.255785 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 367/711] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Apr 29 20:00:55 2022] GET /identity/v3/services => generated 1002 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 20:00:55.455431 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584c88b-68a9-44c0-8390-c4335dcc7497 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:55.455947 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584c88b-68a9-44c0-8390-c4335dcc7497 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:55.455947 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584c88b-68a9-44c0-8390-c4335dcc7497 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:55.457645 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 345/712] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:55.463619 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87cd1e-1196-4681-9ece-dcca360782f1 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:55.463844 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87cd1e-1196-4681-9ece-dcca360782f1 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:55.464144 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87cd1e-1196-4681-9ece-dcca360782f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:55.481800 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-fe87cd1e-1196-4681-9ece-dcca360782f1 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:55.482995 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-fe87cd1e-1196-4681-9ece-dcca360782f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:55.556086 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 368/713] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:55 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 20:00:55.573535 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584c88b-68a9-44c0-8390-c4335dcc7497 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:55.676043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584c88b-68a9-44c0-8390-c4335dcc7497 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:55.708712 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63987d76-e340-4158-b90c-49127f4404f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:55.710148 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63987d76-e340-4158-b90c-49127f4404f8 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:55.710437 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63987d76-e340-4158-b90c-49127f4404f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:55.710761 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63987d76-e340-4158-b90c-49127f4404f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:55.721174 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63987d76-e340-4158-b90c-49127f4404f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-63987d76-e340-4158-b90c-49127f4404f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:00:55.729304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:55.730254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:55.731194 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:55.731194 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:55.731194 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:55.731194 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:55.731194 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:00:55.731194 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:00:55.731194 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:00:55.731194 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:00:55.731194 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:00:55.731194 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:00:55.731194 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:00:55.731194 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:55.735358 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 346/714] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 20:00:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:55.736759 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87cd1e-1196-4681-9ece-dcca360782f1 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:55.835242 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87cd1e-1196-4681-9ece-dcca360782f1 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:55.872922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b6a08-5436-4c0b-a939-7334aa78d63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:55.873593 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b6a08-5436-4c0b-a939-7334aa78d63a None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:55.873872 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b6a08-5436-4c0b-a939-7334aa78d63a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:55.874140 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b6a08-5436-4c0b-a939-7334aa78d63a None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:55.874882 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b6a08-5436-4c0b-a939-7334aa78d63a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:55.875182 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b6a08-5436-4c0b-a939-7334aa78d63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:55.876668 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b6a08-5436-4c0b-a939-7334aa78d63a None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:55.885776 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 369/715] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:00:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:55.891183 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63987d76-e340-4158-b90c-49127f4404f8 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:55.993221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63987d76-e340-4158-b90c-49127f4404f8 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:56.030197 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b78ff-8d98-40ce-97e2-10f1ef67720f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:56.035425 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b78ff-8d98-40ce-97e2-10f1ef67720f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:56.035425 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b78ff-8d98-40ce-97e2-10f1ef67720f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:56.035425 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b78ff-8d98-40ce-97e2-10f1ef67720f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:56.043522 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b78ff-8d98-40ce-97e2-10f1ef67720f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:56.045366 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b78ff-8d98-40ce-97e2-10f1ef67720f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:56.065091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-561b78ff-8d98-40ce-97e2-10f1ef67720f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:56.065091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:56.065091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:56.065091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:56.065091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:56.065091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:56.065091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:56.065091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:56.065091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:56.065091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:56.065091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:56.065091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:56.065091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:56.065091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:56.065091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:56.066098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:56.067073 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:56.067073 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:56.067073 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:56.067073 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:56.070140 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 347/716] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:56.076697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b6a08-5436-4c0b-a939-7334aa78d63a None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:56.182560 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b6a08-5436-4c0b-a939-7334aa78d63a None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:56.217749 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d0b62-b4e6-4447-b62e-6c4b013eb7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:56.218416 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d0b62-b4e6-4447-b62e-6c4b013eb7e9 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:56.218693 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d0b62-b4e6-4447-b62e-6c4b013eb7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:56.218964 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d0b62-b4e6-4447-b62e-6c4b013eb7e9 None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:56.219681 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d0b62-b4e6-4447-b62e-6c4b013eb7e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:56.220000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d0b62-b4e6-4447-b62e-6c4b013eb7e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:56.221378 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d0b62-b4e6-4447-b62e-6c4b013eb7e9 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:56.233959 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 370/717] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:56.239293 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b78ff-8d98-40ce-97e2-10f1ef67720f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:56.260084 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4d931-b838-4a03-869a-05a69ef75510 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:56.260084 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4d931-b838-4a03-869a-05a69ef75510 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:56.260084 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4d931-b838-4a03-869a-05a69ef75510 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:56.260084 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 371/718] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:56.263916 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc48837-9547-4084-80b1-203430e22657 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:56.264235 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc48837-9547-4084-80b1-203430e22657 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:56.264509 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc48837-9547-4084-80b1-203430e22657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:56.280691 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-4cc48837-9547-4084-80b1-203430e22657 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:56.281844 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-4cc48837-9547-4084-80b1-203430e22657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:56.347997 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b78ff-8d98-40ce-97e2-10f1ef67720f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:56.359300 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 372/719] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:56 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 20:00:56.377866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc48837-9547-4084-80b1-203430e22657 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:56.380685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900525cc-952b-49e8-93c8-51986291d672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:56.381539 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900525cc-952b-49e8-93c8-51986291d672 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:56.381812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900525cc-952b-49e8-93c8-51986291d672 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:56.382080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900525cc-952b-49e8-93c8-51986291d672 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:56.389867 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900525cc-952b-49e8-93c8-51986291d672 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:56.391304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900525cc-952b-49e8-93c8-51986291d672 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-900525cc-952b-49e8-93c8-51986291d672 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:00:56.405534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:56.406516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:56.407458 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:56.407458 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:56.407458 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:00:56.407458 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:00:56.407458 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:00:56.407458 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:00:56.407458 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:00:56.407458 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:00:56.407458 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 29 20:00:56.407458 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:56.407458 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 348/720] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Apr 29 20:00:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:56.412915 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900525cc-952b-49e8-93c8-51986291d672 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:56.482232 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc48837-9547-4084-80b1-203430e22657 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:56.512015 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900525cc-952b-49e8-93c8-51986291d672 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:56.516123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13370d6f-e07a-4f19-9d61-63a1fad8fc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:56.516919 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13370d6f-e07a-4f19-9d61-63a1fad8fc3e None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:56.517199 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13370d6f-e07a-4f19-9d61-63a1fad8fc3e None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:56.517472 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13370d6f-e07a-4f19-9d61-63a1fad8fc3e None admin] PATH_INFO: `/v3/services/image` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:56.518128 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13370d6f-e07a-4f19-9d61-63a1fad8fc3e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:56.519510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13370d6f-e07a-4f19-9d61-63a1fad8fc3e None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-13370d6f-e07a-4f19-9d61-63a1fad8fc3e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:56.531367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:56.533750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:56.535768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:56.535768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:56.535768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:56.535768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:56.535768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:56.535768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:56.535768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:56.535768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:56.535768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:56.535768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:56.535768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:00:56.535768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:56.535768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 29 20:00:56.535768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:56.538115 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 373/721] 10.222.0.58 () {56 vars in 1105 bytes} [Fri Apr 29 20:00:56 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:56.539605 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13370d6f-e07a-4f19-9d61-63a1fad8fc3e None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:56.546690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ace5d1-fbea-4b0a-974c-3d1da1d274a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:56.547382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ace5d1-fbea-4b0a-974c-3d1da1d274a9 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:56.547661 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ace5d1-fbea-4b0a-974c-3d1da1d274a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:56.547933 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ace5d1-fbea-4b0a-974c-3d1da1d274a9 None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:56.548832 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ace5d1-fbea-4b0a-974c-3d1da1d274a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:56.549141 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ace5d1-fbea-4b0a-974c-3d1da1d274a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:56.550608 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ace5d1-fbea-4b0a-974c-3d1da1d274a9 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:56.574908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 349/722] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Apr 29 20:00:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:56.576318 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ace5d1-fbea-4b0a-974c-3d1da1d274a9 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:56.660856 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13370d6f-e07a-4f19-9d61-63a1fad8fc3e None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:56.690638 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ace5d1-fbea-4b0a-974c-3d1da1d274a9 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:56.704631 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6a2fb-a3bc-4ce9-a168-e123293af75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:56.705856 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6a2fb-a3bc-4ce9-a168-e123293af75a None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:56.706371 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6a2fb-a3bc-4ce9-a168-e123293af75a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:56.706983 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6a2fb-a3bc-4ce9-a168-e123293af75a None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:56.708222 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6a2fb-a3bc-4ce9-a168-e123293af75a None admin] RBAC: Adding query filter params (name=image) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:56.709478 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6a2fb-a3bc-4ce9-a168-e123293af75a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:56.711543 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6a2fb-a3bc-4ce9-a168-e123293af75a None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:56.718688 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 374/723] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:56.724150 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6a2fb-a3bc-4ce9-a168-e123293af75a None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:56.728256 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d461b-21bd-425b-a485-6ac50c0d3016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:56.729943 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d461b-21bd-425b-a485-6ac50c0d3016 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:56.730461 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d461b-21bd-425b-a485-6ac50c0d3016 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:56.730949 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d461b-21bd-425b-a485-6ac50c0d3016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:56.809522 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d461b-21bd-425b-a485-6ac50c0d3016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:56.810751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d461b-21bd-425b-a485-6ac50c0d3016 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:56.838093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6a2fb-a3bc-4ce9-a168-e123293af75a None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:56.873023 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97504e1-1a9e-409d-aa3f-d106113de716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:56.873876 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97504e1-1a9e-409d-aa3f-d106113de716 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:56.874255 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97504e1-1a9e-409d-aa3f-d106113de716 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:56.874626 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97504e1-1a9e-409d-aa3f-d106113de716 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:56.875449 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97504e1-1a9e-409d-aa3f-d106113de716 None admin] RBAC: Adding query filter params (type=image) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:56.875826 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97504e1-1a9e-409d-aa3f-d106113de716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:56.877428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97504e1-1a9e-409d-aa3f-d106113de716 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:56.887127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 375/724] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:56.888578 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97504e1-1a9e-409d-aa3f-d106113de716 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:56.932147 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 350/725] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:56 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 20:00:56.938422 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d461b-21bd-425b-a485-6ac50c0d3016 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:57.014252 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97504e1-1a9e-409d-aa3f-d106113de716 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:57.048442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27804044-d503-48b3-8a3f-d17fe6a035e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:57.049381 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27804044-d503-48b3-8a3f-d17fe6a035e0 None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:57.049381 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27804044-d503-48b3-8a3f-d17fe6a035e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:57.049691 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27804044-d503-48b3-8a3f-d17fe6a035e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:57.050376 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27804044-d503-48b3-8a3f-d17fe6a035e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:57.051875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27804044-d503-48b3-8a3f-d17fe6a035e0 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:57.059869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d461b-21bd-425b-a485-6ac50c0d3016 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:57.095110 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4d76f-0673-482e-a01f-00cc513ba4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:57.095903 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4d76f-0673-482e-a01f-00cc513ba4af None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:57.096214 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4d76f-0673-482e-a01f-00cc513ba4af None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:57.096485 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4d76f-0673-482e-a01f-00cc513ba4af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:57.106984 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4d76f-0673-482e-a01f-00cc513ba4af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:57.108534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4d76f-0673-482e-a01f-00cc513ba4af None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:57.126112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-5ee4d76f-0673-482e-a01f-00cc513ba4af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:57.126112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:57.126112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:57.126112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:57.126112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:57.126112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:57.126112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:57.126112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:57.126112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:57.126112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:57.126112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:57.126112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:57.126112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:00:57.126112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:00:57.126112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:57.127091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:57.128042 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:00:57.128042 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:00:57.128042 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:00:57.128042 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:57.132412 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 351/726] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:57.133627 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4d76f-0673-482e-a01f-00cc513ba4af None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:57.139385 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 376/727] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Apr 29 20:00:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 20:00:57.157475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce897e36-125f-4bdf-b090-977ee573f6ce None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:57.157794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce897e36-125f-4bdf-b090-977ee573f6ce None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:57.161994 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce897e36-125f-4bdf-b090-977ee573f6ce None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:57.161994 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 377/728] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:00:57.165721 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b7f8c-ba1b-4343-9e7c-62e4cebb1cd2 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:57.168244 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b7f8c-ba1b-4343-9e7c-62e4cebb1cd2 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:57.168244 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b7f8c-ba1b-4343-9e7c-62e4cebb1cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:57.185282 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-199b7f8c-ba1b-4343-9e7c-62e4cebb1cd2 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:57.187525 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-199b7f8c-ba1b-4343-9e7c-62e4cebb1cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:57.251792 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4d76f-0673-482e-a01f-00cc513ba4af None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:57.288316 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc47fb-363d-4cf9-b214-c4d294d96455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:57.288991 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc47fb-363d-4cf9-b214-c4d294d96455 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:57.289271 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc47fb-363d-4cf9-b214-c4d294d96455 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:57.289541 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc47fb-363d-4cf9-b214-c4d294d96455 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:57.290270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc47fb-363d-4cf9-b214-c4d294d96455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:57.290572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc47fb-363d-4cf9-b214-c4d294d96455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:57.291966 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc47fb-363d-4cf9-b214-c4d294d96455 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:57.292446 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 378/729] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:57 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 20:00:57.309662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 352/730] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:57.311281 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b7f8c-ba1b-4343-9e7c-62e4cebb1cd2 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:57.313561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc47fb-363d-4cf9-b214-c4d294d96455 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:57.426651 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b7f8c-ba1b-4343-9e7c-62e4cebb1cd2 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:57.446322 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc47fb-363d-4cf9-b214-c4d294d96455 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:57.460957 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e73565-81df-4194-ab4b-d1ad96b55a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:57.461813 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e73565-81df-4194-ab4b-d1ad96b55a96 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:57.462087 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e73565-81df-4194-ab4b-d1ad96b55a96 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:57.462354 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e73565-81df-4194-ab4b-d1ad96b55a96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:57.469209 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e73565-81df-4194-ab4b-d1ad96b55a96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:57.470792 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e73565-81df-4194-ab4b-d1ad96b55a96 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:57.484729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-51e73565-81df-4194-ab4b-d1ad96b55a96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:57.484729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:57.484729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:57.484729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:57.484729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:57.484729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:57.484729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:57.484729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:57.484729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:57.484729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:57.484729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:57.484729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:57.484729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:00:57.484729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:00:57.484729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:57.485650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:57.486541 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:00:57.486541 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:00:57.486541 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:00:57.486541 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:00:57.486541 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:00:57.486541 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:00:57.486541 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:00:57.486541 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:57.486968 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263260d2-d0e7-4a58-b961-f5ab1bbe0ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:57.486968 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263260d2-d0e7-4a58-b961-f5ab1bbe0ff9 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:57.487120 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 379/731] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:57.491212 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263260d2-d0e7-4a58-b961-f5ab1bbe0ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:57.491524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263260d2-d0e7-4a58-b961-f5ab1bbe0ff9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:57.492303 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263260d2-d0e7-4a58-b961-f5ab1bbe0ff9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:57.493346 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e73565-81df-4194-ab4b-d1ad96b55a96 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:57.493694 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263260d2-d0e7-4a58-b961-f5ab1bbe0ff9 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-263260d2-d0e7-4a58-b961-f5ab1bbe0ff9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:57.509377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:57.510371 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:57.511193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:57.511193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:57.511193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:57.511193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:57.511193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:57.511193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:57.511193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:57.511193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:57.511193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:57.511193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:57.511193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:57.511193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:00:57.511193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:57.511193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 29 20:00:57.511193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:00:57.515668 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 353/732] 10.222.0.58 () {56 vars in 1129 bytes} [Fri Apr 29 20:00:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:00:57.516933 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263260d2-d0e7-4a58-b961-f5ab1bbe0ff9 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:57.613472 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e73565-81df-4194-ab4b-d1ad96b55a96 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:57.639187 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263260d2-d0e7-4a58-b961-f5ab1bbe0ff9 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:57.656242 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbdf8e-9ee5-4439-9468-0fa4adf497b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:57.656906 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbdf8e-9ee5-4439-9468-0fa4adf497b0 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:57.657183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbdf8e-9ee5-4439-9468-0fa4adf497b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:57.657455 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbdf8e-9ee5-4439-9468-0fa4adf497b0 None admin] PATH_INFO: `/v3/projects` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:57.658242 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbdf8e-9ee5-4439-9468-0fa4adf497b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:57.658542 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbdf8e-9ee5-4439-9468-0fa4adf497b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:57.660414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbdf8e-9ee5-4439-9468-0fa4adf497b0 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:57.673516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614c7b8-b209-4181-8f58-568b1af2d989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:57.674447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614c7b8-b209-4181-8f58-568b1af2d989 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:57.674944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614c7b8-b209-4181-8f58-568b1af2d989 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:57.676021 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614c7b8-b209-4181-8f58-568b1af2d989 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:57.676172 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 380/733] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:00:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:57.680907 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614c7b8-b209-4181-8f58-568b1af2d989 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:57.681226 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614c7b8-b209-4181-8f58-568b1af2d989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:57.682634 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614c7b8-b209-4181-8f58-568b1af2d989 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:57.684438 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbdf8e-9ee5-4439-9468-0fa4adf497b0 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:57.695105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 354/734] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Apr 29 20:00:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:00:57.696450 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614c7b8-b209-4181-8f58-568b1af2d989 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:57.801123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbdf8e-9ee5-4439-9468-0fa4adf497b0 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:57.803897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614c7b8-b209-4181-8f58-568b1af2d989 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:57.835656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e51ee7-3635-4eae-b657-9b0b8137630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:57.836345 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e51ee7-3635-4eae-b657-9b0b8137630b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:57.836673 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e51ee7-3635-4eae-b657-9b0b8137630b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:57.837005 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e51ee7-3635-4eae-b657-9b0b8137630b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:57.837781 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e51ee7-3635-4eae-b657-9b0b8137630b None admin] RBAC: Adding query filter params (role.id=5255ed3fa613448fb4c549f5bc7f20af, scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c, user.id=ca4e798ccd784e348136af337bf780f6) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:57.838088 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e51ee7-3635-4eae-b657-9b0b8137630b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:57.838602 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b41eaa-8cc3-40a6-8f23-6da2435be3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:57.839249 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b41eaa-8cc3-40a6-8f23-6da2435be3aa None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:57.839502 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e51ee7-3635-4eae-b657-9b0b8137630b None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:57.839684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b41eaa-8cc3-40a6-8f23-6da2435be3aa None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:57.839761 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b41eaa-8cc3-40a6-8f23-6da2435be3aa None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:57.840480 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b41eaa-8cc3-40a6-8f23-6da2435be3aa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:57.840782 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b41eaa-8cc3-40a6-8f23-6da2435be3aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:57.842111 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b41eaa-8cc3-40a6-8f23-6da2435be3aa None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:57.852226 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 381/735] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:00:57 2022] GET /identity/v3/role_assignments?user.id=ca4e798ccd784e348136af337bf780f6&scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c&role.id=5255ed3fa613448fb4c549f5bc7f20af => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:57.852226 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e5a48-5e8f-43bd-a2f5-974e982c06cf None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:57.852226 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e5a48-5e8f-43bd-a2f5-974e982c06cf None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:57.852226 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e5a48-5e8f-43bd-a2f5-974e982c06cf None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:57.852226 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 382/736] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:57.854959 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72bed2-8053-4596-830e-6766de3883f1 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:57.855241 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72bed2-8053-4596-830e-6766de3883f1 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:57.855517 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72bed2-8053-4596-830e-6766de3883f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:57.857952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 355/737] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Apr 29 20:00:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:57.869444 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b41eaa-8cc3-40a6-8f23-6da2435be3aa None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:57.876846 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-3e72bed2-8053-4596-830e-6766de3883f1 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:57.878394 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-3e72bed2-8053-4596-830e-6766de3883f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:57.957193 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 383/738] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:57 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 20:00:57.981444 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72bed2-8053-4596-830e-6766de3883f1 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:58.013885 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b41eaa-8cc3-40a6-8f23-6da2435be3aa None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:58.059557 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679a6ba-f38b-45f2-ba10-8dc96e88d707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:58.060793 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679a6ba-f38b-45f2-ba10-8dc96e88d707 None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:58.060793 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679a6ba-f38b-45f2-ba10-8dc96e88d707 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:58.060793 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679a6ba-f38b-45f2-ba10-8dc96e88d707 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:58.061610 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679a6ba-f38b-45f2-ba10-8dc96e88d707 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:58.063494 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679a6ba-f38b-45f2-ba10-8dc96e88d707 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:58.090876 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72bed2-8053-4596-830e-6766de3883f1 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:58.125560 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3bd2f-0831-4e19-99f1-2da8f89d022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:58.126334 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3bd2f-0831-4e19-99f1-2da8f89d022a None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:58.126609 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3bd2f-0831-4e19-99f1-2da8f89d022a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:58.126884 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3bd2f-0831-4e19-99f1-2da8f89d022a None admin] PATH_INFO: `/v3/services/network` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:58.127532 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3bd2f-0831-4e19-99f1-2da8f89d022a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:58.128956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3bd2f-0831-4e19-99f1-2da8f89d022a None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-cde3bd2f-0831-4e19-99f1-2da8f89d022a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:00:58.140636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:00:58.141723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:00:58.142585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:00:58.142585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:00:58.142585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:00:58.142585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:00:58.142585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:00:58.142585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:00:58.142585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:00:58.142585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:00:58.142585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:00:58.142585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:00:58.142585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:00:58.142585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:00:58.142585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 29 20:00:58.142585 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:00:58.147138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 384/739] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:00:57 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:00:58.154987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 356/740] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Apr 29 20:00:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 20:00:58.155699 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3bd2f-0831-4e19-99f1-2da8f89d022a None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:58.267420 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3bd2f-0831-4e19-99f1-2da8f89d022a None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:58.312960 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf0396-cd5e-4404-afaa-c6236eb403c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:58.313633 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf0396-cd5e-4404-afaa-c6236eb403c9 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:58.313929 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf0396-cd5e-4404-afaa-c6236eb403c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:58.314160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf0396-cd5e-4404-afaa-c6236eb403c9 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:58.314882 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf0396-cd5e-4404-afaa-c6236eb403c9 None admin] RBAC: Adding query filter params (name=network) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:58.315184 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf0396-cd5e-4404-afaa-c6236eb403c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:58.316663 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf0396-cd5e-4404-afaa-c6236eb403c9 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:58.322270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 385/741] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Apr 29 20:00:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:58.333126 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679a6ba-f38b-45f2-ba10-8dc96e88d707 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:58.462011 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679a6ba-f38b-45f2-ba10-8dc96e88d707 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:58.495507 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a8c0e-0eeb-4272-ae28-900f1823f5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:58.496194 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a8c0e-0eeb-4272-ae28-900f1823f5b5 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:58.496476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a8c0e-0eeb-4272-ae28-900f1823f5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:58.496748 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a8c0e-0eeb-4272-ae28-900f1823f5b5 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:58.497444 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a8c0e-0eeb-4272-ae28-900f1823f5b5 None admin] RBAC: Adding query filter params (type=network) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:00:58.497743 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a8c0e-0eeb-4272-ae28-900f1823f5b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:58.499106 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a8c0e-0eeb-4272-ae28-900f1823f5b5 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:58.508255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 357/742] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Apr 29 20:00:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:00:58.513015 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf0396-cd5e-4404-afaa-c6236eb403c9 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:58.614015 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf0396-cd5e-4404-afaa-c6236eb403c9 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:58.647843 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a78904-3aad-4694-bfbd-78421c1280cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:58.648532 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a78904-3aad-4694-bfbd-78421c1280cd None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:58.648811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a78904-3aad-4694-bfbd-78421c1280cd None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:58.649077 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a78904-3aad-4694-bfbd-78421c1280cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:58.649803 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a78904-3aad-4694-bfbd-78421c1280cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:58.651167 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a78904-3aad-4694-bfbd-78421c1280cd None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:58.755059 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 386/743] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Apr 29 20:00:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:00:59.579753 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d712dbe-2d22-4c18-98a9-7fe486486499 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:59.580352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d712dbe-2d22-4c18-98a9-7fe486486499 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:59.580352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d712dbe-2d22-4c18-98a9-7fe486486499 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:59.581831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 358/744] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:00:59.587003 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ff42d-6040-4bfe-970e-c8383b009f2b None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:59.587385 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ff42d-6040-4bfe-970e-c8383b009f2b None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:59.587560 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ff42d-6040-4bfe-970e-c8383b009f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:59.604674 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-0d4ff42d-6040-4bfe-970e-c8383b009f2b None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:00:59.605782 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-0d4ff42d-6040-4bfe-970e-c8383b009f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:00:59.674621 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 387/745] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:00:59 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:00:59.697410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d712dbe-2d22-4c18-98a9-7fe486486499 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:00:59.798892 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d712dbe-2d22-4c18-98a9-7fe486486499 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:00:59.831644 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff86361-de6c-4fb0-9888-99621d29e2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:00:59.832318 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff86361-de6c-4fb0-9888-99621d29e2fe None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:00:59.832600 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff86361-de6c-4fb0-9888-99621d29e2fe None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:00:59.832871 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff86361-de6c-4fb0-9888-99621d29e2fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:00:59.902499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff86361-de6c-4fb0-9888-99621d29e2fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:00:59.903861 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff86361-de6c-4fb0-9888-99621d29e2fe None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:00:59.999386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 359/746] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:00:59 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 20:01:00.004836 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ff42d-6040-4bfe-970e-c8383b009f2b None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:00.100428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ff42d-6040-4bfe-970e-c8383b009f2b None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:00.135490 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223f626-7f8e-4661-afae-7f722a7181b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:00.136302 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223f626-7f8e-4661-afae-7f722a7181b5 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:00.136577 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223f626-7f8e-4661-afae-7f722a7181b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:00.136842 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223f626-7f8e-4661-afae-7f722a7181b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:00.147127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223f626-7f8e-4661-afae-7f722a7181b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:00.148600 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223f626-7f8e-4661-afae-7f722a7181b5 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:00.165316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-e223f626-7f8e-4661-afae-7f722a7181b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:01:00.165316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:00.165316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:01:00.165316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:01:00.165316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:01:00.165316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:01:00.165316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:01:00.165316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:01:00.165316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:01:00.165316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:01:00.165316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:01:00.165316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:01:00.165316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:01:00.165316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:01:00.165316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:01:00.166196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:01:00.167087 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:01:00.167087 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:01:00.167087 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:01:00.167087 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:01:00.167850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 388/747] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:01:00.172311 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff86361-de6c-4fb0-9888-99621d29e2fe None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:00.265666 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff86361-de6c-4fb0-9888-99621d29e2fe None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:00.284039 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9a7d2-0cc1-44c9-ad7b-9ddfecbef688 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:00.284334 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9a7d2-0cc1-44c9-ad7b-9ddfecbef688 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:00.284597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9a7d2-0cc1-44c9-ad7b-9ddfecbef688 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:00.286078 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 389/748] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:01:00.290805 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442f295-387c-4a9c-b96d-708fe501dc5c None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:00.291087 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442f295-387c-4a9c-b96d-708fe501dc5c None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:00.291360 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442f295-387c-4a9c-b96d-708fe501dc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:00.299804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c085f-4a8e-4dea-b667-d19a9bfe3857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:00.300487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c085f-4a8e-4dea-b667-d19a9bfe3857 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:00.300770 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c085f-4a8e-4dea-b667-d19a9bfe3857 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:00.301044 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c085f-4a8e-4dea-b667-d19a9bfe3857 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:00.302175 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c085f-4a8e-4dea-b667-d19a9bfe3857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:00.302488 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c085f-4a8e-4dea-b667-d19a9bfe3857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:00.304202 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c085f-4a8e-4dea-b667-d19a9bfe3857 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:00.307470 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-6442f295-387c-4a9c-b96d-708fe501dc5c None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:01:00.308674 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-6442f295-387c-4a9c-b96d-708fe501dc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:01:00.317404 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 360/749] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:01:00.386099 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 390/750] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:01:00 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 20:01:00.410172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c085f-4a8e-4dea-b667-d19a9bfe3857 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:00.519362 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c085f-4a8e-4dea-b667-d19a9bfe3857 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:00.552181 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5affb-1efb-4193-9007-e7d5fa498953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:00.553517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5affb-1efb-4193-9007-e7d5fa498953 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:00.553790 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5affb-1efb-4193-9007-e7d5fa498953 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:00.554054 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5affb-1efb-4193-9007-e7d5fa498953 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:00.554692 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5affb-1efb-4193-9007-e7d5fa498953 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:00.556349 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5affb-1efb-4193-9007-e7d5fa498953 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-e4d5affb-1efb-4193-9007-e7d5fa498953 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:01:00.572415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:01:00.573410 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:01:00.574255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:01:00.574255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:01:00.574255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:01:00.574255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:01:00.574255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:01:00.574255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:01:00.574255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:01:00.574255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:01:00.574255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:01:00.574255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:01:00.574255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:01:00.574255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:01:00.574255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:00.574255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 20:01:00.574255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:00.576290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 361/751] 10.222.0.58 () {56 vars in 1132 bytes} [Fri Apr 29 20:01:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:01:00.581547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442f295-387c-4a9c-b96d-708fe501dc5c None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:00.642440 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8494d-f4c2-45bb-b6f2-bcae0a5eb443 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:00.642976 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8494d-f4c2-45bb-b6f2-bcae0a5eb443 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:00.642976 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8494d-f4c2-45bb-b6f2-bcae0a5eb443 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:00.644640 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 362/752] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:01:00.649925 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abeddf-9e57-485a-b29d-ed19dee900ad None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:00.651757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abeddf-9e57-485a-b29d-ed19dee900ad None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:00.651757 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abeddf-9e57-485a-b29d-ed19dee900ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:00.667185 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-14abeddf-9e57-485a-b29d-ed19dee900ad None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:01:00.668613 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-14abeddf-9e57-485a-b29d-ed19dee900ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:01:00.685380 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442f295-387c-4a9c-b96d-708fe501dc5c None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:00.718401 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc865083-6c89-4554-accb-6a98f1b5281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:00.719058 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865083-6c89-4554-accb-6a98f1b5281e None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:00.719334 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865083-6c89-4554-accb-6a98f1b5281e None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:00.719605 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865083-6c89-4554-accb-6a98f1b5281e None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:00.720510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc865083-6c89-4554-accb-6a98f1b5281e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:00.720664 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc865083-6c89-4554-accb-6a98f1b5281e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:00.722043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc865083-6c89-4554-accb-6a98f1b5281e None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:00.726656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 391/753] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Apr 29 20:01:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:01:00.732210 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc865083-6c89-4554-accb-6a98f1b5281e None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:00.732952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 363/754] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:01:00 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 20:01:00.757170 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abeddf-9e57-485a-b29d-ed19dee900ad None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:00.824035 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc865083-6c89-4554-accb-6a98f1b5281e None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:00.848528 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abeddf-9e57-485a-b29d-ed19dee900ad None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:00.857403 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e36401-d57d-4a36-963a-65e13ba1d3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:00.858412 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e36401-d57d-4a36-963a-65e13ba1d3f8 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:00.858687 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e36401-d57d-4a36-963a-65e13ba1d3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:00.858975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e36401-d57d-4a36-963a-65e13ba1d3f8 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:00.859670 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e36401-d57d-4a36-963a-65e13ba1d3f8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:00.860184 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e36401-d57d-4a36-963a-65e13ba1d3f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:00.861947 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e36401-d57d-4a36-963a-65e13ba1d3f8 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:00.867956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 392/755] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Apr 29 20:01:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:01:00.886412 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3df49-9be1-4625-863a-616ca8626c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:00.887238 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3df49-9be1-4625-863a-616ca8626c84 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:00.887520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3df49-9be1-4625-863a-616ca8626c84 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:00.887793 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3df49-9be1-4625-863a-616ca8626c84 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:00.888500 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3df49-9be1-4625-863a-616ca8626c84 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:00.889910 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3df49-9be1-4625-863a-616ca8626c84 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-77f3df49-9be1-4625-863a-616ca8626c84 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:01:00.902553 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:01:00.903855 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:01:00.905071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:01:00.905071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:01:00.905071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:01:00.905071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:01:00.905071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:01:00.905071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:01:00.905071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:01:00.905071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:01:00.905071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:01:00.905071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:01:00.905071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:01:00.905071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:00.905071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 20:01:00.905071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:00.905071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 364/756] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 20:01:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:01:00.910078 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e36401-d57d-4a36-963a-65e13ba1d3f8 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:01.013470 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e36401-d57d-4a36-963a-65e13ba1d3f8 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:01.048011 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90ac8c-06f7-40f3-ab66-c8dccdbf8558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:01.048682 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90ac8c-06f7-40f3-ab66-c8dccdbf8558 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:01.048964 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90ac8c-06f7-40f3-ab66-c8dccdbf8558 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:01.049240 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90ac8c-06f7-40f3-ab66-c8dccdbf8558 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:01.049945 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90ac8c-06f7-40f3-ab66-c8dccdbf8558 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:01.050253 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90ac8c-06f7-40f3-ab66-c8dccdbf8558 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:01.052081 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90ac8c-06f7-40f3-ab66-c8dccdbf8558 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:01.057922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 393/757] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 20:01:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:01:01.063121 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3df49-9be1-4625-863a-616ca8626c84 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:01.161942 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3df49-9be1-4625-863a-616ca8626c84 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:01.197352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530be177-c30a-461b-ad4c-c7979b012c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:01.198009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530be177-c30a-461b-ad4c-c7979b012c07 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:01.198292 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530be177-c30a-461b-ad4c-c7979b012c07 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:01.198569 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530be177-c30a-461b-ad4c-c7979b012c07 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:01.199268 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530be177-c30a-461b-ad4c-c7979b012c07 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:01.199576 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530be177-c30a-461b-ad4c-c7979b012c07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:01.200985 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530be177-c30a-461b-ad4c-c7979b012c07 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:01.205243 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 365/758] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 20:01:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:01:03.240300 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058e888-da95-4efb-a916-5ac1491bc6ac None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:03.240851 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058e888-da95-4efb-a916-5ac1491bc6ac None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:03.240851 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058e888-da95-4efb-a916-5ac1491bc6ac None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:03.242171 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 394/759] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:01:03.247258 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561103ab-7d6c-4816-989f-cea1348d48a8 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:03.247664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561103ab-7d6c-4816-989f-cea1348d48a8 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:03.247883 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561103ab-7d6c-4816-989f-cea1348d48a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:03.266068 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-561103ab-7d6c-4816-989f-cea1348d48a8 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:01:03.267243 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-561103ab-7d6c-4816-989f-cea1348d48a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:01:03.344029 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 366/760] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:01:03 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:01:03.367913 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058e888-da95-4efb-a916-5ac1491bc6ac None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:03.463941 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058e888-da95-4efb-a916-5ac1491bc6ac None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:03.495900 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1680ea0-d2d6-4ae9-8fd7-dd11800450ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:03.496508 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1680ea0-d2d6-4ae9-8fd7-dd11800450ff None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:03.496791 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1680ea0-d2d6-4ae9-8fd7-dd11800450ff None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:03.497063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1680ea0-d2d6-4ae9-8fd7-dd11800450ff None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:03.497768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1680ea0-d2d6-4ae9-8fd7-dd11800450ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:03.499118 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1680ea0-d2d6-4ae9-8fd7-dd11800450ff None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:03.518274 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eafdb-7101-4d77-a9ab-a01cf2945ec7 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:03.518562 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eafdb-7101-4d77-a9ab-a01cf2945ec7 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:03.518841 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eafdb-7101-4d77-a9ab-a01cf2945ec7 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:03.520276 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 367/761] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:01:03.525043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b127fd5-b857-49b0-849b-21c4d91a879c None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:03.525322 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b127fd5-b857-49b0-849b-21c4d91a879c None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:03.525595 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b127fd5-b857-49b0-849b-21c4d91a879c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:03.541685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-0b127fd5-b857-49b0-849b-21c4d91a879c None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:01:03.542853 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-0b127fd5-b857-49b0-849b-21c4d91a879c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:01:03.567180 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 395/762] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Apr 29 20:01:03 2022] POST /identity/v3/services => generated 269 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:01:03.618463 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 368/763] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:01:03 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 20:01:03.643389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1680ea0-d2d6-4ae9-8fd7-dd11800450ff None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:03.749352 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1680ea0-d2d6-4ae9-8fd7-dd11800450ff None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:03.782224 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec45be-d67c-410f-9b4e-e5a07c788a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:03.782937 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec45be-d67c-410f-9b4e-e5a07c788a7f None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:03.783218 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec45be-d67c-410f-9b4e-e5a07c788a7f None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:03.783497 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec45be-d67c-410f-9b4e-e5a07c788a7f None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:03.784261 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec45be-d67c-410f-9b4e-e5a07c788a7f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:03.785619 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec45be-d67c-410f-9b4e-e5a07c788a7f None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:03.875676 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 396/764] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Apr 29 20:01:03 2022] POST /identity/v3/services => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:01:05.913645 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae6253-8fec-4339-930e-383736746667 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:05.914182 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae6253-8fec-4339-930e-383736746667 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:05.914591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae6253-8fec-4339-930e-383736746667 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:05.916517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 369/765] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:01:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:01:05.922492 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e92a3-5d69-49de-bfca-a0a65e7940d3 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:05.922907 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e92a3-5d69-49de-bfca-a0a65e7940d3 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:05.923043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e92a3-5d69-49de-bfca-a0a65e7940d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:05.939689 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-476e92a3-5d69-49de-bfca-a0a65e7940d3 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:01:05.940922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-476e92a3-5d69-49de-bfca-a0a65e7940d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:01:06.013983 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 397/766] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:01:05 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:01:06.038722 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae6253-8fec-4339-930e-383736746667 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:06.137551 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae6253-8fec-4339-930e-383736746667 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:06.170132 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfb15c-a024-44b1-b665-9b0effe7864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:06.170844 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfb15c-a024-44b1-b665-9b0effe7864f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:06.171119 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfb15c-a024-44b1-b665-9b0effe7864f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:06.171385 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfb15c-a024-44b1-b665-9b0effe7864f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:06.172117 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfb15c-a024-44b1-b665-9b0effe7864f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:06.173473 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfb15c-a024-44b1-b665-9b0effe7864f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:06.178806 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b6717-5200-4557-a2d7-0a5836f67a8e None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:06.179092 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b6717-5200-4557-a2d7-0a5836f67a8e None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:06.179369 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b6717-5200-4557-a2d7-0a5836f67a8e None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:06.180734 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 398/767] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:01:06.185443 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c04eb-af6c-4aef-974e-50072be81437 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:06.185722 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c04eb-af6c-4aef-974e-50072be81437 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:06.185994 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c04eb-af6c-4aef-974e-50072be81437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-a8dfb15c-a024-44b1-b665-9b0effe7864f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:01:06.186172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:01:06.187285 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:06.188339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 370/768] 10.222.0.58 () {56 vars in 1132 bytes} [Fri Apr 29 20:01:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:01:06.193148 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfb15c-a024-44b1-b665-9b0effe7864f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:06.204154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-ed2c04eb-af6c-4aef-974e-50072be81437 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:01:06.205325 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-ed2c04eb-af6c-4aef-974e-50072be81437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:01:06.268433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 399/769] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:01:06 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 20:01:06.285694 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfb15c-a024-44b1-b665-9b0effe7864f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:06.293076 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c04eb-af6c-4aef-974e-50072be81437 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:06.318179 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364574e-9e95-433f-9151-ab07ae21764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:06.318827 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364574e-9e95-433f-9151-ab07ae21764c None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:06.319105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364574e-9e95-433f-9151-ab07ae21764c None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:06.319377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364574e-9e95-433f-9151-ab07ae21764c None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:06.320097 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364574e-9e95-433f-9151-ab07ae21764c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:06.320403 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364574e-9e95-433f-9151-ab07ae21764c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:06.321772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364574e-9e95-433f-9151-ab07ae21764c None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:06.326219 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 371/770] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Apr 29 20:01:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:01:06.331803 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364574e-9e95-433f-9151-ab07ae21764c None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:06.387172 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c04eb-af6c-4aef-974e-50072be81437 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:06.419850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712e4eb-77db-4dd9-aa3d-2f4729393f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:06.420717 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712e4eb-77db-4dd9-aa3d-2f4729393f5e None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:06.420947 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712e4eb-77db-4dd9-aa3d-2f4729393f5e None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:06.421216 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712e4eb-77db-4dd9-aa3d-2f4729393f5e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:06.421889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712e4eb-77db-4dd9-aa3d-2f4729393f5e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:06.423262 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712e4eb-77db-4dd9-aa3d-2f4729393f5e None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:06.425450 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364574e-9e95-433f-9151-ab07ae21764c None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-c712e4eb-77db-4dd9-aa3d-2f4729393f5e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:01:06.434887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:01:06.435858 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:01:06.436899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:01:06.436899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:01:06.436899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:01:06.436899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:01:06.436899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:01:06.436899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:01:06.436899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:01:06.436899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:01:06.436899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:01:06.436899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:01:06.436899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:01:06.436899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:06.436899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 20:01:06.436899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:01:06.436899 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 400/771] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 20:01:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:01:06.442037 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712e4eb-77db-4dd9-aa3d-2f4729393f5e None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:06.457426 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3662281-35a8-4976-afcd-b123ae64366f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:06.458089 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3662281-35a8-4976-afcd-b123ae64366f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:06.458372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3662281-35a8-4976-afcd-b123ae64366f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:06.459140 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3662281-35a8-4976-afcd-b123ae64366f None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:06.459832 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3662281-35a8-4976-afcd-b123ae64366f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:06.460171 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3662281-35a8-4976-afcd-b123ae64366f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:06.461536 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3662281-35a8-4976-afcd-b123ae64366f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:06.466105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 372/772] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Apr 29 20:01:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:01:06.471761 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3662281-35a8-4976-afcd-b123ae64366f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:06.535255 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712e4eb-77db-4dd9-aa3d-2f4729393f5e None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:06.564578 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3662281-35a8-4976-afcd-b123ae64366f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:06.569168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be337978-c1e7-4879-bc9e-eb7d9d92d989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:06.569823 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be337978-c1e7-4879-bc9e-eb7d9d92d989 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:06.570102 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be337978-c1e7-4879-bc9e-eb7d9d92d989 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:06.570377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be337978-c1e7-4879-bc9e-eb7d9d92d989 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:06.571069 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be337978-c1e7-4879-bc9e-eb7d9d92d989 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:06.571370 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be337978-c1e7-4879-bc9e-eb7d9d92d989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:06.572771 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be337978-c1e7-4879-bc9e-eb7d9d92d989 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:06.577302 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 401/773] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 20:01:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:01:06.582793 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be337978-c1e7-4879-bc9e-eb7d9d92d989 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:06.596705 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af2ef9-b219-4181-b8be-40130af6cb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:06.597353 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2ef9-b219-4181-b8be-40130af6cb63 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:06.597627 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2ef9-b219-4181-b8be-40130af6cb63 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:06.597899 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2ef9-b219-4181-b8be-40130af6cb63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:06.598668 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af2ef9-b219-4181-b8be-40130af6cb63 None admin] RBAC: Adding query filter params (interface=public, service_id=6e296b99628245d79034f74f8f25958f, region_id=RegionOne) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:06.598975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af2ef9-b219-4181-b8be-40130af6cb63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:06.600965 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af2ef9-b219-4181-b8be-40130af6cb63 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:06.605965 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 373/774] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Apr 29 20:01:06 2022] GET /identity/v3/endpoints?service_id=6e296b99628245d79034f74f8f25958f&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:01:06.611380 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af2ef9-b219-4181-b8be-40130af6cb63 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:06.677192 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be337978-c1e7-4879-bc9e-eb7d9d92d989 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:06.701827 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af2ef9-b219-4181-b8be-40130af6cb63 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:06.708249 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98236fe3-2e2d-46ed-a323-4eaebf12dbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:06.709437 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98236fe3-2e2d-46ed-a323-4eaebf12dbbb None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:06.709715 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98236fe3-2e2d-46ed-a323-4eaebf12dbbb None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:06.709986 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98236fe3-2e2d-46ed-a323-4eaebf12dbbb None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:06.710675 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98236fe3-2e2d-46ed-a323-4eaebf12dbbb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:06.710974 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98236fe3-2e2d-46ed-a323-4eaebf12dbbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:06.712373 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98236fe3-2e2d-46ed-a323-4eaebf12dbbb None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:06.716934 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 402/775] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 20:01:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:01:06.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98236fe3-2e2d-46ed-a323-4eaebf12dbbb None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:06.734518 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efaf275-9cb6-4a91-966b-257142d84805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:06.735172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaf275-9cb6-4a91-966b-257142d84805 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:06.735450 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaf275-9cb6-4a91-966b-257142d84805 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:06.735726 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaf275-9cb6-4a91-966b-257142d84805 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:06.736440 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efaf275-9cb6-4a91-966b-257142d84805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:06.737803 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efaf275-9cb6-4a91-966b-257142d84805 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:06.743506 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 374/776] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Apr 29 20:01:06 2022] GET /identity/v3/services => generated 1498 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 20:01:06.825847 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98236fe3-2e2d-46ed-a323-4eaebf12dbbb None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:06.859734 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b392fa-d730-4db8-a7ea-dce10e87aa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:06.860424 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b392fa-d730-4db8-a7ea-dce10e87aa7b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:06.860703 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b392fa-d730-4db8-a7ea-dce10e87aa7b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:06.860973 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b392fa-d730-4db8-a7ea-dce10e87aa7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:06.861762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b392fa-d730-4db8-a7ea-dce10e87aa7b None admin] RBAC: Adding query filter params (interface=public, service_id=a3ed397705f84bd9b95a78558bfad4bc, region_id=RegionOne) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:06.862067 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b392fa-d730-4db8-a7ea-dce10e87aa7b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:06.863445 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b392fa-d730-4db8-a7ea-dce10e87aa7b None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:06.869014 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 403/777] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Apr 29 20:01:06 2022] GET /identity/v3/endpoints?service_id=a3ed397705f84bd9b95a78558bfad4bc&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:01:06.874637 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efaf275-9cb6-4a91-966b-257142d84805 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:06.971127 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efaf275-9cb6-4a91-966b-257142d84805 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:07.002120 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328f72e-0c18-4c1d-946b-11583a79f065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:07.002767 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328f72e-0c18-4c1d-946b-11583a79f065 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:07.003044 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328f72e-0c18-4c1d-946b-11583a79f065 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:07.003313 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328f72e-0c18-4c1d-946b-11583a79f065 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:07.004060 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328f72e-0c18-4c1d-946b-11583a79f065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:07.005348 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328f72e-0c18-4c1d-946b-11583a79f065 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:07.011567 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 375/778] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Apr 29 20:01:06 2022] GET /identity/v3/services => generated 1498 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 20:01:09.025047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a928f3-80ad-43ce-88c0-faf98bd15529 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:09.025674 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a928f3-80ad-43ce-88c0-faf98bd15529 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:09.025674 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a928f3-80ad-43ce-88c0-faf98bd15529 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:09.026947 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 404/779] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:01:09.032314 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc10ae9-11d6-4154-8cc4-5321b3816f13 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:09.032758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc10ae9-11d6-4154-8cc4-5321b3816f13 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:09.032897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc10ae9-11d6-4154-8cc4-5321b3816f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:09.049618 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-5fc10ae9-11d6-4154-8cc4-5321b3816f13 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:01:09.050791 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-5fc10ae9-11d6-4154-8cc4-5321b3816f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:01:09.114412 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 376/780] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:01:09 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:01:09.138771 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a928f3-80ad-43ce-88c0-faf98bd15529 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:09.237118 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a928f3-80ad-43ce-88c0-faf98bd15529 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:09.268373 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b1de7-5073-49aa-931c-1011a188bbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:09.269174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b1de7-5073-49aa-931c-1011a188bbbe None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:09.269451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b1de7-5073-49aa-931c-1011a188bbbe None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:09.269720 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b1de7-5073-49aa-931c-1011a188bbbe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:09.270358 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b1de7-5073-49aa-931c-1011a188bbbe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:09.271897 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b1de7-5073-49aa-931c-1011a188bbbe None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-4e9b1de7-5073-49aa-931c-1011a188bbbe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:01:09.283841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:01:09.290273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:01:09.291407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 405/781] 10.222.0.58 () {56 vars in 1132 bytes} [Fri Apr 29 20:01:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:01:09.293597 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc10ae9-11d6-4154-8cc4-5321b3816f13 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:09.324829 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1447ba-32f6-481a-815e-23026d3b19ed None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:09.325111 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1447ba-32f6-481a-815e-23026d3b19ed None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:09.325381 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1447ba-32f6-481a-815e-23026d3b19ed None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:09.326701 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 406/782] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:01:09.331599 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d28603-ce27-4656-97e2-e6e2d2b1df92 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:09.331882 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d28603-ce27-4656-97e2-e6e2d2b1df92 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:09.332184 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d28603-ce27-4656-97e2-e6e2d2b1df92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:09.348303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-f4d28603-ce27-4656-97e2-e6e2d2b1df92 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:01:09.350012 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-f4d28603-ce27-4656-97e2-e6e2d2b1df92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:01:09.388095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc10ae9-11d6-4154-8cc4-5321b3816f13 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:09.414529 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 407/783] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:01:09 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 20:01:09.420393 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2261b56-7300-4944-a3aa-cd843fbc7e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:09.421049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2261b56-7300-4944-a3aa-cd843fbc7e16 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:09.421325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2261b56-7300-4944-a3aa-cd843fbc7e16 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:09.421593 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2261b56-7300-4944-a3aa-cd843fbc7e16 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:09.422283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2261b56-7300-4944-a3aa-cd843fbc7e16 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:09.422581 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2261b56-7300-4944-a3aa-cd843fbc7e16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:09.423930 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2261b56-7300-4944-a3aa-cd843fbc7e16 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:09.428474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 377/784] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Apr 29 20:01:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:01:09.433935 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d28603-ce27-4656-97e2-e6e2d2b1df92 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:09.438128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2261b56-7300-4944-a3aa-cd843fbc7e16 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:09.528037 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d28603-ce27-4656-97e2-e6e2d2b1df92 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:09.537465 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2261b56-7300-4944-a3aa-cd843fbc7e16 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:09.560234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c847b1-3536-49bd-b40d-c696ae5572cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:09.560889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c847b1-3536-49bd-b40d-c696ae5572cf None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:09.561165 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c847b1-3536-49bd-b40d-c696ae5572cf None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:09.561436 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c847b1-3536-49bd-b40d-c696ae5572cf None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:09.562126 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c847b1-3536-49bd-b40d-c696ae5572cf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:09.562426 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c847b1-3536-49bd-b40d-c696ae5572cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:09.563784 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c847b1-3536-49bd-b40d-c696ae5572cf None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:09.568414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 408/785] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Apr 29 20:01:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:01:09.569152 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed210f-8ce4-4f42-b02a-69fddcebaeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:09.569938 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed210f-8ce4-4f42-b02a-69fddcebaeb3 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:09.570214 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed210f-8ce4-4f42-b02a-69fddcebaeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:09.570483 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed210f-8ce4-4f42-b02a-69fddcebaeb3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:09.571121 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed210f-8ce4-4f42-b02a-69fddcebaeb3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:09.572498 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed210f-8ce4-4f42-b02a-69fddcebaeb3 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:09.573989 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c847b1-3536-49bd-b40d-c696ae5572cf None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-41ed210f-8ce4-4f42-b02a-69fddcebaeb3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:01:09.584501 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:01:09.585698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:01:09.586760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:01:09.586760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:01:09.586760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:01:09.586760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:01:09.586760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:01:09.586760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:01:09.586760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:01:09.586760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:01:09.586760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:01:09.586760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:01:09.586760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:01:09.586760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:09.586760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 29 20:01:09.586760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:09.586760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 378/786] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 20:01:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:01:09.591426 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed210f-8ce4-4f42-b02a-69fddcebaeb3 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:09.671287 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c847b1-3536-49bd-b40d-c696ae5572cf None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:09.687248 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed210f-8ce4-4f42-b02a-69fddcebaeb3 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:09.702539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16cc87-5443-4d97-ab50-035f55daab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:09.703184 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16cc87-5443-4d97-ab50-035f55daab70 None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:09.703463 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16cc87-5443-4d97-ab50-035f55daab70 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:09.703734 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16cc87-5443-4d97-ab50-035f55daab70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:09.704498 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16cc87-5443-4d97-ab50-035f55daab70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:09.705861 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16cc87-5443-4d97-ab50-035f55daab70 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:09.718870 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d87fa-efa0-4d90-9814-64b9d6a47407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:09.719523 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d87fa-efa0-4d90-9814-64b9d6a47407 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:09.719804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d87fa-efa0-4d90-9814-64b9d6a47407 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:09.720102 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d87fa-efa0-4d90-9814-64b9d6a47407 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:09.720800 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d87fa-efa0-4d90-9814-64b9d6a47407 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:09.721105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d87fa-efa0-4d90-9814-64b9d6a47407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:09.722487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d87fa-efa0-4d90-9814-64b9d6a47407 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:09.727923 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 379/787] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 20:01:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:01:09.733766 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d87fa-efa0-4d90-9814-64b9d6a47407 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:09.782268 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 409/788] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Apr 29 20:01:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 20:01:09.833657 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d87fa-efa0-4d90-9814-64b9d6a47407 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:09.874593 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a2b9f-1a01-4ad1-af15-25854c1b27f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:09.875260 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a2b9f-1a01-4ad1-af15-25854c1b27f7 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:09.875536 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a2b9f-1a01-4ad1-af15-25854c1b27f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:09.875805 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a2b9f-1a01-4ad1-af15-25854c1b27f7 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:09.876546 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a2b9f-1a01-4ad1-af15-25854c1b27f7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:09.876850 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a2b9f-1a01-4ad1-af15-25854c1b27f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:09.878274 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a2b9f-1a01-4ad1-af15-25854c1b27f7 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:09.884140 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 380/789] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Apr 29 20:01:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:01:09.889861 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16cc87-5443-4d97-ab50-035f55daab70 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:09.989539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16cc87-5443-4d97-ab50-035f55daab70 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:10.022182 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b32f59-a9fa-4db5-a189-a21cd6211b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:10.022834 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b32f59-a9fa-4db5-a189-a21cd6211b40 None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:10.023110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b32f59-a9fa-4db5-a189-a21cd6211b40 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:10.023375 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b32f59-a9fa-4db5-a189-a21cd6211b40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:10.024143 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b32f59-a9fa-4db5-a189-a21cd6211b40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:10.025495 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b32f59-a9fa-4db5-a189-a21cd6211b40 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:10.127149 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 410/790] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Apr 29 20:01:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 20:01:12.113737 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e834979-1bfa-42dd-9671-c5f0a034c4f3 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:12.114294 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e834979-1bfa-42dd-9671-c5f0a034c4f3 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:12.114294 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e834979-1bfa-42dd-9671-c5f0a034c4f3 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:12.115678 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 381/791] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:01:12.121056 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631b94-4438-4dd5-8e95-bb7cb5c3b5ba None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:12.121496 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631b94-4438-4dd5-8e95-bb7cb5c3b5ba None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:12.121593 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631b94-4438-4dd5-8e95-bb7cb5c3b5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:12.138429 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-58631b94-4438-4dd5-8e95-bb7cb5c3b5ba None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:01:12.139600 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-58631b94-4438-4dd5-8e95-bb7cb5c3b5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:01:12.209501 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 411/792] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:01:12 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:01:12.233165 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e834979-1bfa-42dd-9671-c5f0a034c4f3 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:12.333158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e834979-1bfa-42dd-9671-c5f0a034c4f3 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:12.368905 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4faa29-6daa-48d5-ba5d-3084f88e2934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:12.369631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4faa29-6daa-48d5-ba5d-3084f88e2934 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:12.369910 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4faa29-6daa-48d5-ba5d-3084f88e2934 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:12.370180 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4faa29-6daa-48d5-ba5d-3084f88e2934 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:12.370821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4faa29-6daa-48d5-ba5d-3084f88e2934 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:12.372208 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4faa29-6daa-48d5-ba5d-3084f88e2934 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-9d4faa29-6daa-48d5-ba5d-3084f88e2934 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:01:12.384209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:01:12.385376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:01:12.386662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:01:12.386662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:01:12.386662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:01:12.386662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:01:12.386662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:01:12.386662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:01:12.386662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:01:12.386662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:01:12.386662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:01:12.386662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:01:12.386662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:01:12.386662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:12.386662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 20:01:12.386662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:12.386662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 382/793] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:01:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:01:12.391335 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58631b94-4438-4dd5-8e95-bb7cb5c3b5ba None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:12.443936 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15614a-31a6-4c34-8249-07e6db9773aa None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:12.444247 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15614a-31a6-4c34-8249-07e6db9773aa None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:12.444523 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15614a-31a6-4c34-8249-07e6db9773aa None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:12.445867 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 383/794] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:01:12.450736 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b169f-2d2b-415d-9379-79eb47ce9336 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:12.451021 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b169f-2d2b-415d-9379-79eb47ce9336 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:12.451300 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b169f-2d2b-415d-9379-79eb47ce9336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:12.467130 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-249b169f-2d2b-415d-9379-79eb47ce9336 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:01:12.468334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-249b169f-2d2b-415d-9379-79eb47ce9336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:01:12.483778 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58631b94-4438-4dd5-8e95-bb7cb5c3b5ba None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:12.515886 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443e8d9-475c-4e21-9121-30babddd618a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:12.516576 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443e8d9-475c-4e21-9121-30babddd618a None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:12.516856 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443e8d9-475c-4e21-9121-30babddd618a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:12.517129 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443e8d9-475c-4e21-9121-30babddd618a None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:12.517822 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443e8d9-475c-4e21-9121-30babddd618a None admin] RBAC: Adding query filter params (name=compute) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:12.518126 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443e8d9-475c-4e21-9121-30babddd618a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:12.519487 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443e8d9-475c-4e21-9121-30babddd618a None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:12.523993 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 412/795] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Apr 29 20:01:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:01:12.529491 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443e8d9-475c-4e21-9121-30babddd618a None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:12.531280 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 384/796] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:01:12 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 20:01:12.556325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b169f-2d2b-415d-9379-79eb47ce9336 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:12.621114 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443e8d9-475c-4e21-9121-30babddd618a None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:12.647475 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b169f-2d2b-415d-9379-79eb47ce9336 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:12.652940 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38facc14-ac93-4347-b510-34c76a741021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:12.653592 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38facc14-ac93-4347-b510-34c76a741021 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:12.653870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38facc14-ac93-4347-b510-34c76a741021 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:12.654140 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38facc14-ac93-4347-b510-34c76a741021 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:12.654839 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38facc14-ac93-4347-b510-34c76a741021 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:12.655139 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38facc14-ac93-4347-b510-34c76a741021 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:12.656557 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38facc14-ac93-4347-b510-34c76a741021 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:12.660792 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 413/797] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Apr 29 20:01:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:01:12.681058 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc81d1-d621-4fce-8c1c-1a61442415bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:12.681742 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc81d1-d621-4fce-8c1c-1a61442415bd None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:12.682025 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc81d1-d621-4fce-8c1c-1a61442415bd None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:12.682303 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc81d1-d621-4fce-8c1c-1a61442415bd None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:12.683019 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc81d1-d621-4fce-8c1c-1a61442415bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:12.684535 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc81d1-d621-4fce-8c1c-1a61442415bd None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:12.685955 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: WARNING keystone.server.flask.common [None req-99cc81d1-d621-4fce-8c1c-1a61442415bd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 29 20:01:12.747664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.sql.core [None req-99cc81d1-d621-4fce-8c1c-1a61442415bd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 29 20:01:12.747664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 29 20:01:12.747664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [parameters: {'id': '1826f878916e457d8ceaaad1fda1a6dd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 29 20:01:12.747664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87060) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 29 20:01:12.764961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-99cc81d1-d621-4fce-8c1c-1a61442415bd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1826f878916e457d8ceaaad1fda1a6dd.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1826f878916e457d8ceaaad1fda1a6dd. Apr 29 20:01:12.764961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:12.764961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 29 20:01:12.764961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 29 20:01:12.764961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 29 20:01:12.764961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 29 20:01:12.764961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 29 20:01:12.764961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application result = self._query(query) Apr 29 20:01:12.764961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 29 20:01:12.764961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application conn.query(q) Apr 29 20:01:12.764961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 29 20:01:12.764961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 29 20:01:12.764961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application result.read() Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return method(*args, **kwargs) Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Apr 29 20:01:12.765974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return project_ref.to_dict() Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application next(self.gen) Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application yield resource Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application next(self.gen) Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self.session.rollback() Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self.force_reraise() Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise self.value Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application session.commit() Apr 29 20:01:12.767026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1431, in commit Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._prepare_impl() Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self.session.flush() Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3363, in flush Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._flush(objects) Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3503, in _flush Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application compat.raise_( Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3463, in _flush Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application flush_context.execute() Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Apr 29 20:01:12.767958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rec.execute(self) Apr 29 20:01:12.769392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Apr 29 20:01:12.769392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Apr 29 20:01:12.769392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Apr 29 20:01:12.769392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application _emit_insert_statements( Apr 29 20:01:12.769392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Apr 29 20:01:12.769392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application c = connection._execute_20( Apr 29 20:01:12.769392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Apr 29 20:01:12.769392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Apr 29 20:01:12.769392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Apr 29 20:01:12.769392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Apr 29 20:01:12.769392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Apr 29 20:01:12.769392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ret = self._execute_context( Apr 29 20:01:12.769392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Apr 29 20:01:12.769392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Apr 29 20:01:12.769392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application result = self._query(query) Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application conn.query(q) Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application result.read() Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 29 20:01:12.770487 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 29 20:01:12.771709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 29 20:01:12.771709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 29 20:01:12.771709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 29 20:01:12.771709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 29 20:01:12.771709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 29 20:01:12.771709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 29 20:01:12.771709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 29 20:01:12.771709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 29 20:01:12.771709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [parameters: {'id': '1826f878916e457d8ceaaad1fda1a6dd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 29 20:01:12.771709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Apr 29 20:01:12.771709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:12.771709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:01:12.771709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:12.771709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:12.771709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:01:12.772738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:01:12.774016 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:01:12.774016 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Apr 29 20:01:12.774016 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Apr 29 20:01:12.774016 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:01:12.774016 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:01:12.774016 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Apr 29 20:01:12.774016 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.Conflict( Apr 29 20:01:12.774016 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1826f878916e457d8ceaaad1fda1a6dd. Apr 29 20:01:12.774016 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:12.774016 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 385/798] 10.222.0.58 () {60 vars in 1140 bytes} [Fri Apr 29 20:01:12 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:01:12.774773 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38facc14-ac93-4347-b510-34c76a741021 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:12.874188 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38facc14-ac93-4347-b510-34c76a741021 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:12.905580 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b970c8b-9a6e-41d5-9908-b889cb1fb2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:12.906360 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b970c8b-9a6e-41d5-9908-b889cb1fb2d7 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:12.906638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b970c8b-9a6e-41d5-9908-b889cb1fb2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:12.906908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b970c8b-9a6e-41d5-9908-b889cb1fb2d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:12.913816 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b970c8b-9a6e-41d5-9908-b889cb1fb2d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:12.915260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b970c8b-9a6e-41d5-9908-b889cb1fb2d7 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:12.928924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-8b970c8b-9a6e-41d5-9908-b889cb1fb2d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:01:12.928924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:12.928924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:01:12.928924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:01:12.928924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:01:12.928924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:01:12.928924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:01:12.928924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:01:12.928924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:01:12.928924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:01:12.928924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:01:12.928924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:01:12.928924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:01:12.928924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:01:12.928924 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:01:12.929965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:01:12.930987 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:01:12.930987 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:01:12.930987 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:01:12.930987 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:01:12.930987 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:01:12.930987 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:01:12.930987 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:01:12.930987 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:01:12.930987 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 414/799] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:01:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:01:12.936246 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc81d1-d621-4fce-8c1c-1a61442415bd None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:13.032209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc81d1-d621-4fce-8c1c-1a61442415bd None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:13.066534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49dfe6-9f06-41f5-9efb-4a9ce5282705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:13.067193 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49dfe6-9f06-41f5-9efb-4a9ce5282705 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:13.067473 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49dfe6-9f06-41f5-9efb-4a9ce5282705 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:13.067781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49dfe6-9f06-41f5-9efb-4a9ce5282705 None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:13.068574 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49dfe6-9f06-41f5-9efb-4a9ce5282705 None admin] RBAC: Adding query filter params (name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:13.068871 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49dfe6-9f06-41f5-9efb-4a9ce5282705 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:13.070504 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49dfe6-9f06-41f5-9efb-4a9ce5282705 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:13.092700 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 386/800] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Apr 29 20:01:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:01:15.007715 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02865e-82fd-4351-8d63-61b5d6cf8a7e None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:15.008288 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02865e-82fd-4351-8d63-61b5d6cf8a7e None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:15.008288 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02865e-82fd-4351-8d63-61b5d6cf8a7e None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:15.009657 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 415/801] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:01:15.015036 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113db5c-80a6-495f-b5a3-d8bae27e83fc None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:15.015513 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113db5c-80a6-495f-b5a3-d8bae27e83fc None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:15.015657 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113db5c-80a6-495f-b5a3-d8bae27e83fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:15.034356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-b113db5c-80a6-495f-b5a3-d8bae27e83fc None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:01:15.035859 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-b113db5c-80a6-495f-b5a3-d8bae27e83fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:01:15.099631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 387/802] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:01:15 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 29 20:01:15.123608 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02865e-82fd-4351-8d63-61b5d6cf8a7e None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:15.225523 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02865e-82fd-4351-8d63-61b5d6cf8a7e None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:15.260242 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6620d8-8f3c-4b4c-9a67-c29b86b33d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:15.260839 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6620d8-8f3c-4b4c-9a67-c29b86b33d8e None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:15.261117 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6620d8-8f3c-4b4c-9a67-c29b86b33d8e None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:15.261389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6620d8-8f3c-4b4c-9a67-c29b86b33d8e None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:15.262115 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6620d8-8f3c-4b4c-9a67-c29b86b33d8e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:15.263486 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6620d8-8f3c-4b4c-9a67-c29b86b33d8e None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:15.373140 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 416/803] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Apr 29 20:01:15 2022] POST /identity/v3/services => generated 242 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:01:15.426419 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54715b40-e005-4564-b331-c6dfba69b606 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:15.426704 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54715b40-e005-4564-b331-c6dfba69b606 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:15.427464 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54715b40-e005-4564-b331-c6dfba69b606 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:15.428962 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 388/804] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:01:15.434920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e7444-a675-40ec-8b04-1d9e797a9042 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:15.435203 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e7444-a675-40ec-8b04-1d9e797a9042 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:15.435479 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e7444-a675-40ec-8b04-1d9e797a9042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:15.454802 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-ea4e7444-a675-40ec-8b04-1d9e797a9042 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:01:15.456046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-ea4e7444-a675-40ec-8b04-1d9e797a9042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:01:15.529196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 417/805] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:01:15 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:01:15.555155 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54715b40-e005-4564-b331-c6dfba69b606 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:15.651894 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54715b40-e005-4564-b331-c6dfba69b606 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:15.683793 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff5381-d623-4c9b-b6d4-9955f3b63de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:15.684476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff5381-d623-4c9b-b6d4-9955f3b63de2 None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:15.684756 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff5381-d623-4c9b-b6d4-9955f3b63de2 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:15.685031 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff5381-d623-4c9b-b6d4-9955f3b63de2 None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:15.685719 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff5381-d623-4c9b-b6d4-9955f3b63de2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:15.687143 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff5381-d623-4c9b-b6d4-9955f3b63de2 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:15.726759 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.sql.core [None req-42ff5381-d623-4c9b-b6d4-9955f3b63de2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 29 20:01:15.726759 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 29 20:01:15.726759 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [parameters: {'user_id': '5263974d303b4773b02e48654d62e94f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 29 20:01:15.726759 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87060) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 29 20:01:15.734447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-42ff5381-d623-4c9b-b6d4-9955f3b63de2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 29 20:01:15.734447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:15.734447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 29 20:01:15.734447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 29 20:01:15.734447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 29 20:01:15.734447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 29 20:01:15.734447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 29 20:01:15.734447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application result = self._query(query) Apr 29 20:01:15.734447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 29 20:01:15.734447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application conn.query(q) Apr 29 20:01:15.734447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 29 20:01:15.734447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 29 20:01:15.734447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 29 20:01:15.734447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application result.read() Apr 29 20:01:15.734447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return method(*args, **kwargs) Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 29 20:01:15.735320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application next(self.gen) Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application yield resource Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application next(self.gen) Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self.session.rollback() Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self.force_reraise() Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise self.value Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application session.commit() Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1431, in commit Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Apr 29 20:01:15.736290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._prepare_impl() Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self.session.flush() Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3363, in flush Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._flush(objects) Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3503, in _flush Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application compat.raise_( Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3463, in _flush Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application flush_context.execute() Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rec.execute(self) Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Apr 29 20:01:15.737325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application _emit_insert_statements( Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application result = connection._execute_20( Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ret = self._execute_context( Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 29 20:01:15.738189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application result = self._query(query) Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application conn.query(q) Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application result.read() Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 29 20:01:15.739063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 29 20:01:15.740396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 29 20:01:15.740396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 29 20:01:15.740396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 29 20:01:15.740396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 29 20:01:15.740396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 29 20:01:15.740396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 29 20:01:15.740396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [parameters: {'user_id': '5263974d303b4773b02e48654d62e94f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 29 20:01:15.740396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Apr 29 20:01:15.740396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:15.740396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:01:15.740396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:15.740396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:15.740396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:01:15.740396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:01:15.740396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Apr 29 20:01:15.743100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Apr 29 20:01:15.744370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Apr 29 20:01:15.744370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Apr 29 20:01:15.744370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Apr 29 20:01:15.744370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Apr 29 20:01:15.744370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 29 20:01:15.744370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:15.744370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 389/806] 10.222.0.58 () {60 vars in 1131 bytes} [Fri Apr 29 20:01:15 2022] POST /identity/v3/users => generated 160 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:01:15.745038 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e7444-a675-40ec-8b04-1d9e797a9042 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:15.836397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e7444-a675-40ec-8b04-1d9e797a9042 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:15.868975 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64502d00-add2-406a-9fa1-2b50bc3f2f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:15.869835 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64502d00-add2-406a-9fa1-2b50bc3f2f48 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:15.870076 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64502d00-add2-406a-9fa1-2b50bc3f2f48 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:15.870340 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64502d00-add2-406a-9fa1-2b50bc3f2f48 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:15.877034 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64502d00-add2-406a-9fa1-2b50bc3f2f48 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:15.878528 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64502d00-add2-406a-9fa1-2b50bc3f2f48 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-64502d00-add2-406a-9fa1-2b50bc3f2f48 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:01:15.892559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:01:15.893692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:01:15.894875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:01:15.894875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:01:15.894875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:01:15.894875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:01:15.894875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:01:15.894875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:01:15.894875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:01:15.894875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:01:15.894875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 29 20:01:15.894875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:01:15.896135 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 418/807] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:01:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:01:15.899698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff5381-d623-4c9b-b6d4-9955f3b63de2 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:16.000560 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff5381-d623-4c9b-b6d4-9955f3b63de2 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:16.033124 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf27214-82ff-40d2-a6da-6ecd07155072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:16.033815 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf27214-82ff-40d2-a6da-6ecd07155072 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:16.034094 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf27214-82ff-40d2-a6da-6ecd07155072 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:16.034366 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf27214-82ff-40d2-a6da-6ecd07155072 None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:16.035156 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf27214-82ff-40d2-a6da-6ecd07155072 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:16.035458 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf27214-82ff-40d2-a6da-6ecd07155072 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:16.037602 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf27214-82ff-40d2-a6da-6ecd07155072 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:16.073787 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 390/808] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Apr 29 20:01:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:01:17.676832 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754893e-6e54-4df4-97dd-7b37fc3134b5 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:17.677867 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754893e-6e54-4df4-97dd-7b37fc3134b5 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:17.677867 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754893e-6e54-4df4-97dd-7b37fc3134b5 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:17.679131 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 419/809] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:01:17.684518 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbba3f2-0eb8-4063-9e31-2b263cba8125 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:17.684893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbba3f2-0eb8-4063-9e31-2b263cba8125 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:17.685133 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbba3f2-0eb8-4063-9e31-2b263cba8125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:17.702320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-cdbba3f2-0eb8-4063-9e31-2b263cba8125 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:01:17.703816 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-cdbba3f2-0eb8-4063-9e31-2b263cba8125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:01:17.766644 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 391/810] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:01:17 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:01:17.789648 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754893e-6e54-4df4-97dd-7b37fc3134b5 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:17.885611 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754893e-6e54-4df4-97dd-7b37fc3134b5 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:17.917497 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7bd74-3013-48e2-ad30-2947a5e0ce2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:17.918273 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7bd74-3013-48e2-ad30-2947a5e0ce2f None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:17.918553 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7bd74-3013-48e2-ad30-2947a5e0ce2f None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:17.918823 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7bd74-3013-48e2-ad30-2947a5e0ce2f None admin] PATH_INFO: `/v3/services/compute` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:17.919459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7bd74-3013-48e2-ad30-2947a5e0ce2f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:17.920849 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7bd74-3013-48e2-ad30-2947a5e0ce2f None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-d6f7bd74-3013-48e2-ad30-2947a5e0ce2f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:01:17.932731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:01:17.933679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:01:17.934555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:01:17.934555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:01:17.934555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:01:17.934555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:01:17.934555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:01:17.934555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:01:17.934555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:01:17.934555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:01:17.934555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:01:17.934555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:01:17.934555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:01:17.934555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:17.934555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 20:01:17.934555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:01:17.934555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 420/811] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:01:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:01:17.939835 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbba3f2-0eb8-4063-9e31-2b263cba8125 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:18.040211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbba3f2-0eb8-4063-9e31-2b263cba8125 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:18.071781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ddf23-8cbe-4b3a-9e03-114c1c235d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:18.072459 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ddf23-8cbe-4b3a-9e03-114c1c235d5e None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:18.072733 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ddf23-8cbe-4b3a-9e03-114c1c235d5e None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:18.073002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ddf23-8cbe-4b3a-9e03-114c1c235d5e None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:18.073696 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ddf23-8cbe-4b3a-9e03-114c1c235d5e None admin] RBAC: Adding query filter params (name=compute) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:18.073997 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ddf23-8cbe-4b3a-9e03-114c1c235d5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:18.075348 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ddf23-8cbe-4b3a-9e03-114c1c235d5e None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:18.079908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 392/812] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Apr 29 20:01:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:01:18.085540 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7bd74-3013-48e2-ad30-2947a5e0ce2f None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:18.179701 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7bd74-3013-48e2-ad30-2947a5e0ce2f None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:18.210980 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82bef4-ed1c-4fb9-8428-6efcdcfff772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:18.211613 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82bef4-ed1c-4fb9-8428-6efcdcfff772 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:18.211889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82bef4-ed1c-4fb9-8428-6efcdcfff772 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:18.212187 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82bef4-ed1c-4fb9-8428-6efcdcfff772 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:18.212885 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82bef4-ed1c-4fb9-8428-6efcdcfff772 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:18.213187 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82bef4-ed1c-4fb9-8428-6efcdcfff772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:18.214561 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82bef4-ed1c-4fb9-8428-6efcdcfff772 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:18.219293 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 421/813] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Apr 29 20:01:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:01:18.225644 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ddf23-8cbe-4b3a-9e03-114c1c235d5e None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:18.318009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ddf23-8cbe-4b3a-9e03-114c1c235d5e None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:18.350448 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7088a9-1b1f-467a-8055-f935257cc010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:18.351095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7088a9-1b1f-467a-8055-f935257cc010 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:18.351369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7088a9-1b1f-467a-8055-f935257cc010 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:18.351636 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7088a9-1b1f-467a-8055-f935257cc010 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:18.352709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7088a9-1b1f-467a-8055-f935257cc010 None admin] RBAC: Adding query filter params (interface=public, service_id=d42a1b99997c47e8b14e66a7ca87b445, region_id=RegionOne) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:18.353012 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7088a9-1b1f-467a-8055-f935257cc010 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:18.354372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7088a9-1b1f-467a-8055-f935257cc010 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:18.359204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 393/814] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Apr 29 20:01:18 2022] GET /identity/v3/endpoints?service_id=d42a1b99997c47e8b14e66a7ca87b445&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:01:18.365228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82bef4-ed1c-4fb9-8428-6efcdcfff772 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:18.464372 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82bef4-ed1c-4fb9-8428-6efcdcfff772 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:18.509046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807ca91-7a23-472c-a296-b07d33b25be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:18.509845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807ca91-7a23-472c-a296-b07d33b25be8 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:18.510166 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807ca91-7a23-472c-a296-b07d33b25be8 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:18.510432 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807ca91-7a23-472c-a296-b07d33b25be8 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:18.511444 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807ca91-7a23-472c-a296-b07d33b25be8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:18.513616 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807ca91-7a23-472c-a296-b07d33b25be8 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:18.520106 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 422/815] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Apr 29 20:01:18 2022] GET /identity/v3/services => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 20:01:20.816014 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55f3b6-5b84-47ee-a38b-2ce6f54206cb None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:20.816539 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55f3b6-5b84-47ee-a38b-2ce6f54206cb None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:20.816539 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55f3b6-5b84-47ee-a38b-2ce6f54206cb None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:20.817875 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 394/816] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:01:20.823270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06644cf-85d6-4f41-884c-25755d480e4b None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:20.823646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06644cf-85d6-4f41-884c-25755d480e4b None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:20.823825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06644cf-85d6-4f41-884c-25755d480e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:20.961841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-c06644cf-85d6-4f41-884c-25755d480e4b None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:01:20.963035 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-c06644cf-85d6-4f41-884c-25755d480e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:01:21.026612 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 423/817] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:01:20 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:01:21.050766 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55f3b6-5b84-47ee-a38b-2ce6f54206cb None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:21.146265 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55f3b6-5b84-47ee-a38b-2ce6f54206cb None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:21.176767 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e2703-889f-497e-aa4e-f068e04dcd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:21.177543 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e2703-889f-497e-aa4e-f068e04dcd3f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:21.177819 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e2703-889f-497e-aa4e-f068e04dcd3f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:21.178087 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e2703-889f-497e-aa4e-f068e04dcd3f None admin] PATH_INFO: `/v3/services/compute` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:21.178717 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e2703-889f-497e-aa4e-f068e04dcd3f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:21.180448 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e2703-889f-497e-aa4e-f068e04dcd3f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-6e6e2703-889f-497e-aa4e-f068e04dcd3f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:01:21.192263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:01:21.193924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:01:21.194964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:01:21.194964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:01:21.194964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:01:21.194964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:01:21.194964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:01:21.194964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:01:21.194964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:01:21.194964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:01:21.194964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:01:21.194964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:01:21.194964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:01:21.194964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:01:21.194964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 29 20:01:21.194964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:01:21.194964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 395/818] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:01:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:01:21.199920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06644cf-85d6-4f41-884c-25755d480e4b None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:21.290996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06644cf-85d6-4f41-884c-25755d480e4b None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:21.322168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbca419-5455-428f-810c-3a20d5fad1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:21.322811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbca419-5455-428f-810c-3a20d5fad1da None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:21.323086 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbca419-5455-428f-810c-3a20d5fad1da None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:21.323354 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbca419-5455-428f-810c-3a20d5fad1da None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:21.324066 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbca419-5455-428f-810c-3a20d5fad1da None admin] RBAC: Adding query filter params (name=compute) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:21.324366 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbca419-5455-428f-810c-3a20d5fad1da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:21.325728 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbca419-5455-428f-810c-3a20d5fad1da None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:21.330173 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 424/819] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Apr 29 20:01:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:01:21.336380 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e2703-889f-497e-aa4e-f068e04dcd3f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:21.428846 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e2703-889f-497e-aa4e-f068e04dcd3f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:21.459682 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28133b3-20cf-43cf-82bc-6d9f647bb208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:21.460351 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28133b3-20cf-43cf-82bc-6d9f647bb208 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:21.460631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28133b3-20cf-43cf-82bc-6d9f647bb208 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:21.460901 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28133b3-20cf-43cf-82bc-6d9f647bb208 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:21.461588 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28133b3-20cf-43cf-82bc-6d9f647bb208 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:01:21.461889 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28133b3-20cf-43cf-82bc-6d9f647bb208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:21.463243 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28133b3-20cf-43cf-82bc-6d9f647bb208 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:21.467790 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 396/820] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Apr 29 20:01:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:01:21.473638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbca419-5455-428f-810c-3a20d5fad1da None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:01:21.565740 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbca419-5455-428f-810c-3a20d5fad1da None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:01:21.596867 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbb01c-393c-47ea-b12e-2cdef068055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:01:21.597496 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbb01c-393c-47ea-b12e-2cdef068055f None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:01:21.597771 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbb01c-393c-47ea-b12e-2cdef068055f None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:01:21.598040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbb01c-393c-47ea-b12e-2cdef068055f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:01:21.598853 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbb01c-393c-47ea-b12e-2cdef068055f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:01:21.600213 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbb01c-393c-47ea-b12e-2cdef068055f None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:01:21.720193 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 425/821] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Apr 29 20:01:21 2022] POST /identity/v3/endpoints => generated 334 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 20:02:41.662529 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc6cdc-5034-44a4-be89-0812b5287a5d None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:41.663098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc6cdc-5034-44a4-be89-0812b5287a5d None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:41.663098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc6cdc-5034-44a4-be89-0812b5287a5d None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:41.664395 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 397/822] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:02:41.669674 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfc84c-2af3-4790-8796-2ca3e85a0a2b None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:41.670133 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfc84c-2af3-4790-8796-2ca3e85a0a2b None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:41.670234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfc84c-2af3-4790-8796-2ca3e85a0a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:41.686911 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-61dfc84c-2af3-4790-8796-2ca3e85a0a2b None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:02:41.688107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-61dfc84c-2af3-4790-8796-2ca3e85a0a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:02:41.755943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 426/823] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:02:41 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:02:41.782311 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc6cdc-5034-44a4-be89-0812b5287a5d None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:41.879895 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc6cdc-5034-44a4-be89-0812b5287a5d None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:41.911994 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05608fc-beb0-4fcf-82e5-f0b85d6d133c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:41.912834 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05608fc-beb0-4fcf-82e5-f0b85d6d133c None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:41.913062 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05608fc-beb0-4fcf-82e5-f0b85d6d133c None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:41.913330 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05608fc-beb0-4fcf-82e5-f0b85d6d133c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:41.923833 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05608fc-beb0-4fcf-82e5-f0b85d6d133c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:41.925305 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05608fc-beb0-4fcf-82e5-f0b85d6d133c None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:41.942821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-f05608fc-beb0-4fcf-82e5-f0b85d6d133c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:41.942821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:41.942821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:41.942821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:41.942821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:41.942821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:41.942821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:41.942821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:41.942821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:41.942821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:41.942821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:41.942821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:41.942821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:02:41.942821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:02:41.942821 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:41.943932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:41.950162 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:02:41.950162 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:02:41.950162 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:41.950162 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:02:41.950162 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 398/824] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:41.950539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfc84c-2af3-4790-8796-2ca3e85a0a2b None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:42.043695 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfc84c-2af3-4790-8796-2ca3e85a0a2b None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:42.075147 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a04400-7962-44ed-8e7c-6ff6ab7d1126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:42.075788 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a04400-7962-44ed-8e7c-6ff6ab7d1126 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:42.076097 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a04400-7962-44ed-8e7c-6ff6ab7d1126 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:42.076365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a04400-7962-44ed-8e7c-6ff6ab7d1126 None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:42.077068 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a04400-7962-44ed-8e7c-6ff6ab7d1126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:42.077367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a04400-7962-44ed-8e7c-6ff6ab7d1126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:42.078717 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a04400-7962-44ed-8e7c-6ff6ab7d1126 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:42.089450 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 427/825] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:42.095246 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05608fc-beb0-4fcf-82e5-f0b85d6d133c None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:42.192252 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05608fc-beb0-4fcf-82e5-f0b85d6d133c None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:42.223393 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a345f0-2136-4630-90d1-b29899fbd7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:42.224076 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a345f0-2136-4630-90d1-b29899fbd7f0 None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:42.224353 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a345f0-2136-4630-90d1-b29899fbd7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:42.224623 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a345f0-2136-4630-90d1-b29899fbd7f0 None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:42.225315 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a345f0-2136-4630-90d1-b29899fbd7f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:42.226986 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a345f0-2136-4630-90d1-b29899fbd7f0 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:42.362517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 399/826] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Apr 29 20:02:42 2022] POST /identity/v3/users => generated 251 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 20:02:44.694662 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883f632-6dc9-40e7-b2b1-a01470e7eb84 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:44.695252 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883f632-6dc9-40e7-b2b1-a01470e7eb84 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:44.695252 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883f632-6dc9-40e7-b2b1-a01470e7eb84 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:44.696548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 428/827] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:02:44.702361 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6460adc-5b76-4ac7-b0ca-a7f94e134d3d None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:44.702803 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6460adc-5b76-4ac7-b0ca-a7f94e134d3d None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:44.702963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6460adc-5b76-4ac7-b0ca-a7f94e134d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:44.719395 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-c6460adc-5b76-4ac7-b0ca-a7f94e134d3d None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:02:44.720611 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-c6460adc-5b76-4ac7-b0ca-a7f94e134d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:02:44.785549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 400/828] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:02:44 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:02:44.809994 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883f632-6dc9-40e7-b2b1-a01470e7eb84 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:44.907464 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883f632-6dc9-40e7-b2b1-a01470e7eb84 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:44.940935 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f60c94-2d97-4ff6-bb6d-39fdc5f8ff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:44.941723 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f60c94-2d97-4ff6-bb6d-39fdc5f8ff7a None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:44.942001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f60c94-2d97-4ff6-bb6d-39fdc5f8ff7a None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:44.942275 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f60c94-2d97-4ff6-bb6d-39fdc5f8ff7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:44.952570 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f60c94-2d97-4ff6-bb6d-39fdc5f8ff7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-97f60c94-2d97-4ff6-bb6d-39fdc5f8ff7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:02:44.960200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:44.961298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:44.962246 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:44.962246 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:44.962246 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:44.962246 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:44.962246 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:02:44.962246 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:02:44.962246 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:02:44.962246 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:02:44.962246 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:02:44.962246 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:02:44.962246 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:02:44.962246 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:02:44.962246 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 429/829] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:02:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:44.967470 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6460adc-5b76-4ac7-b0ca-a7f94e134d3d None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:45.063664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6460adc-5b76-4ac7-b0ca-a7f94e134d3d None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:45.095601 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd08fe-e70a-45ec-99b3-c979f39ab81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:45.096293 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd08fe-e70a-45ec-99b3-c979f39ab81d None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:45.096572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd08fe-e70a-45ec-99b3-c979f39ab81d None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:45.096842 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd08fe-e70a-45ec-99b3-c979f39ab81d None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:45.097574 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd08fe-e70a-45ec-99b3-c979f39ab81d None admin] RBAC: Adding query filter params (name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:45.097927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd08fe-e70a-45ec-99b3-c979f39ab81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:45.099295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd08fe-e70a-45ec-99b3-c979f39ab81d None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:45.107649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 401/830] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Apr 29 20:02:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:45.113398 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f60c94-2d97-4ff6-bb6d-39fdc5f8ff7a None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:45.207885 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f60c94-2d97-4ff6-bb6d-39fdc5f8ff7a None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:45.241148 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce19cb-148c-4dbd-b54b-d336c48cd1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:45.241927 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce19cb-148c-4dbd-b54b-d336c48cd1b4 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:45.242207 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce19cb-148c-4dbd-b54b-d336c48cd1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:45.242479 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce19cb-148c-4dbd-b54b-d336c48cd1b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:45.252777 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce19cb-148c-4dbd-b54b-d336c48cd1b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:45.254217 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce19cb-148c-4dbd-b54b-d336c48cd1b4 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:45.270278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-94ce19cb-148c-4dbd-b54b-d336c48cd1b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:45.270278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:45.270278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:45.270278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:45.270278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:45.270278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:45.270278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:45.270278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:45.270278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:45.270278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:45.270278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:45.270278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:45.270278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:02:45.270278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:02:45.270278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:45.271189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:45.272143 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:02:45.272143 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:02:45.272143 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:45.272143 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:02:45.272143 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 430/831] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:45.277781 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd08fe-e70a-45ec-99b3-c979f39ab81d None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:45.372917 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd08fe-e70a-45ec-99b3-c979f39ab81d None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:45.404130 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b942be-a3f9-470c-aceb-d0655a25188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:45.404792 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b942be-a3f9-470c-aceb-d0655a25188f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:45.405080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b942be-a3f9-470c-aceb-d0655a25188f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:45.405345 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b942be-a3f9-470c-aceb-d0655a25188f None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:45.406053 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b942be-a3f9-470c-aceb-d0655a25188f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:45.406382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b942be-a3f9-470c-aceb-d0655a25188f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:45.407712 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b942be-a3f9-470c-aceb-d0655a25188f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:45.419521 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 402/832] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:45.425163 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce19cb-148c-4dbd-b54b-d336c48cd1b4 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:45.522468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce19cb-148c-4dbd-b54b-d336c48cd1b4 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:45.554045 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a07cf3-30de-4063-ad16-6dfe8fad18b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:45.554830 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a07cf3-30de-4063-ad16-6dfe8fad18b4 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:45.555168 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a07cf3-30de-4063-ad16-6dfe8fad18b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:45.555442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a07cf3-30de-4063-ad16-6dfe8fad18b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:45.562774 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a07cf3-30de-4063-ad16-6dfe8fad18b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:45.564240 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a07cf3-30de-4063-ad16-6dfe8fad18b4 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-d0a07cf3-30de-4063-ad16-6dfe8fad18b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:02:45.578748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:45.579736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:45.581174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:45.581174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:45.581174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:02:45.581174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:02:45.581174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:02:45.581174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:02:45.581174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:02:45.581174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:02:45.581174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 29 20:02:45.581174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:02:45.581174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 431/833] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:02:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:45.585697 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b942be-a3f9-470c-aceb-d0655a25188f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:45.680042 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b942be-a3f9-470c-aceb-d0655a25188f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:45.712334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83159f62-dd6b-456a-a6d3-42b219a49f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:45.712998 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83159f62-dd6b-456a-a6d3-42b219a49f9d None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:45.713885 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83159f62-dd6b-456a-a6d3-42b219a49f9d None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:45.714162 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83159f62-dd6b-456a-a6d3-42b219a49f9d None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:45.714983 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83159f62-dd6b-456a-a6d3-42b219a49f9d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:45.715364 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83159f62-dd6b-456a-a6d3-42b219a49f9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:45.716828 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83159f62-dd6b-456a-a6d3-42b219a49f9d None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:45.733923 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 403/834] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Apr 29 20:02:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:45.740893 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a07cf3-30de-4063-ad16-6dfe8fad18b4 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:45.835185 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a07cf3-30de-4063-ad16-6dfe8fad18b4 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:45.867089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d181597-f39d-4eaf-9084-6d25f96e77ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:45.867726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d181597-f39d-4eaf-9084-6d25f96e77ed None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:45.868031 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d181597-f39d-4eaf-9084-6d25f96e77ed None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:45.868303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d181597-f39d-4eaf-9084-6d25f96e77ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:45.931192 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d181597-f39d-4eaf-9084-6d25f96e77ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:45.933228 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d181597-f39d-4eaf-9084-6d25f96e77ed None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:46.027967 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 432/835] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:02:45 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 20:02:46.034758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83159f62-dd6b-456a-a6d3-42b219a49f9d None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:46.129550 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83159f62-dd6b-456a-a6d3-42b219a49f9d None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:46.161686 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060e06e-d2ff-4a6a-8481-8831c6e2d99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:46.162461 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060e06e-d2ff-4a6a-8481-8831c6e2d99f None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:46.162740 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060e06e-d2ff-4a6a-8481-8831c6e2d99f None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:46.163010 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060e06e-d2ff-4a6a-8481-8831c6e2d99f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:46.172647 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060e06e-d2ff-4a6a-8481-8831c6e2d99f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:46.174108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060e06e-d2ff-4a6a-8481-8831c6e2d99f None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:46.191866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-4060e06e-d2ff-4a6a-8481-8831c6e2d99f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:46.191866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:46.191866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:46.191866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:46.191866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:46.191866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:46.191866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:46.191866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:46.191866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:46.191866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:46.191866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:46.191866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:46.191866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:02:46.191866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:02:46.191866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:46.192963 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:46.194262 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:02:46.194262 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:02:46.194262 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:46.194262 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:02:46.194262 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 404/836] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:46.199503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d181597-f39d-4eaf-9084-6d25f96e77ed None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:46.293362 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d181597-f39d-4eaf-9084-6d25f96e77ed None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:46.326782 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b2564-9679-462d-af6c-c418e3836920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:46.327440 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b2564-9679-462d-af6c-c418e3836920 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:46.327720 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b2564-9679-462d-af6c-c418e3836920 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:46.328018 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b2564-9679-462d-af6c-c418e3836920 None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:46.328729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b2564-9679-462d-af6c-c418e3836920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:46.329034 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b2564-9679-462d-af6c-c418e3836920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:46.330387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b2564-9679-462d-af6c-c418e3836920 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:46.341321 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 433/837] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:02:46.348012 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060e06e-d2ff-4a6a-8481-8831c6e2d99f None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:46.441884 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060e06e-d2ff-4a6a-8481-8831c6e2d99f None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:46.474150 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ba7c8-cacb-4874-a3c4-4aa9960feac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:46.474958 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ba7c8-cacb-4874-a3c4-4aa9960feac8 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:46.475232 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ba7c8-cacb-4874-a3c4-4aa9960feac8 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:46.475500 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ba7c8-cacb-4874-a3c4-4aa9960feac8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:46.482686 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ba7c8-cacb-4874-a3c4-4aa9960feac8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:46.484170 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ba7c8-cacb-4874-a3c4-4aa9960feac8 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:46.498049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-109ba7c8-cacb-4874-a3c4-4aa9960feac8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:02:46.498049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:46.498049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:46.498049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:46.498049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:46.498049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:46.498049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:46.498049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:46.498049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:46.498049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:46.498049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:46.498049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:46.498049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:02:46.498049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:02:46.498049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:46.499352 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:46.500688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:02:46.500688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:02:46.500688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:02:46.500688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:02:46.500688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:02:46.500688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:02:46.500688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:02:46.500688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:02:46.500688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 405/838] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:02:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 29 20:02:46.505155 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b2564-9679-462d-af6c-c418e3836920 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:46.603727 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b2564-9679-462d-af6c-c418e3836920 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:46.635691 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78356de9-05b6-472a-8a56-5e840f1925c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:46.636375 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78356de9-05b6-472a-8a56-5e840f1925c4 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:46.636655 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78356de9-05b6-472a-8a56-5e840f1925c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:46.636926 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78356de9-05b6-472a-8a56-5e840f1925c4 None admin] PATH_INFO: `/v3/projects` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:46.637698 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78356de9-05b6-472a-8a56-5e840f1925c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:46.638001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78356de9-05b6-472a-8a56-5e840f1925c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:46.639407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78356de9-05b6-472a-8a56-5e840f1925c4 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:46.650806 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 434/839] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:02:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:46.656837 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ba7c8-cacb-4874-a3c4-4aa9960feac8 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:46.753075 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ba7c8-cacb-4874-a3c4-4aa9960feac8 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:46.783996 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680d588-a52d-496e-95c5-11bdbf45d5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:46.784628 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680d588-a52d-496e-95c5-11bdbf45d5cd None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:46.784905 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680d588-a52d-496e-95c5-11bdbf45d5cd None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:46.785171 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680d588-a52d-496e-95c5-11bdbf45d5cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:46.785981 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680d588-a52d-496e-95c5-11bdbf45d5cd None admin] RBAC: Adding query filter params (role.id=30572a63e8c84c0fb551e6f8ea95564a, scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c, user.id=1d4caa8120a44bc79044e1459759ce4a) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:46.786305 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680d588-a52d-496e-95c5-11bdbf45d5cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:46.787720 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680d588-a52d-496e-95c5-11bdbf45d5cd None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:46.793546 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 406/840] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:02:46 2022] GET /identity/v3/role_assignments?user.id=1d4caa8120a44bc79044e1459759ce4a&scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c&role.id=30572a63e8c84c0fb551e6f8ea95564a => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:02:49.158472 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f198034-e0a4-4d3e-9a55-5555c2a436e5 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:49.159033 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f198034-e0a4-4d3e-9a55-5555c2a436e5 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:49.159033 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f198034-e0a4-4d3e-9a55-5555c2a436e5 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:49.160403 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 435/841] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:02:49.165635 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd2c15-3676-47c9-ae24-6ed9bdb7bf37 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:49.166063 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd2c15-3676-47c9-ae24-6ed9bdb7bf37 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:49.166171 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd2c15-3676-47c9-ae24-6ed9bdb7bf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:49.182981 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-edfd2c15-3676-47c9-ae24-6ed9bdb7bf37 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:02:49.184218 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-edfd2c15-3676-47c9-ae24-6ed9bdb7bf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:02:49.247212 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 407/842] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:02:49 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:02:49.270900 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f198034-e0a4-4d3e-9a55-5555c2a436e5 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:49.367551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f198034-e0a4-4d3e-9a55-5555c2a436e5 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:49.399712 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3454e-d2be-4a55-85f6-b73b11156a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:49.400535 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3454e-d2be-4a55-85f6-b73b11156a9b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:49.400842 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3454e-d2be-4a55-85f6-b73b11156a9b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:49.401115 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3454e-d2be-4a55-85f6-b73b11156a9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:49.410928 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3454e-d2be-4a55-85f6-b73b11156a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-10d3454e-d2be-4a55-85f6-b73b11156a9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:02:49.419104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:49.421387 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:49.422342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:49.422342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:49.422342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:49.422342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:49.422342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:02:49.422342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:02:49.422342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:02:49.422342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:02:49.422342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:02:49.422342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:02:49.422342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:02:49.422342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:02:49.422342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 436/843] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:02:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:49.426499 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd2c15-3676-47c9-ae24-6ed9bdb7bf37 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:49.523086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd2c15-3676-47c9-ae24-6ed9bdb7bf37 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:49.556138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed477941-4fda-402b-824b-54c1b926e36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:49.556799 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed477941-4fda-402b-824b-54c1b926e36b None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:49.557659 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed477941-4fda-402b-824b-54c1b926e36b None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:49.557931 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed477941-4fda-402b-824b-54c1b926e36b None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:49.558666 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed477941-4fda-402b-824b-54c1b926e36b None admin] RBAC: Adding query filter params (name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:49.558970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed477941-4fda-402b-824b-54c1b926e36b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:49.560367 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed477941-4fda-402b-824b-54c1b926e36b None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:49.568304 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 408/844] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Apr 29 20:02:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:49.573970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3454e-d2be-4a55-85f6-b73b11156a9b None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:49.672762 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3454e-d2be-4a55-85f6-b73b11156a9b None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:49.704269 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f1496-b52b-4ad4-a5d7-4385dc1011da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:49.705043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f1496-b52b-4ad4-a5d7-4385dc1011da None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:49.705317 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f1496-b52b-4ad4-a5d7-4385dc1011da None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:49.705586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f1496-b52b-4ad4-a5d7-4385dc1011da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:49.716030 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f1496-b52b-4ad4-a5d7-4385dc1011da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:49.717461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f1496-b52b-4ad4-a5d7-4385dc1011da None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:49.734794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-fc7f1496-b52b-4ad4-a5d7-4385dc1011da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:49.734794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:49.734794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:49.734794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:49.734794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:49.734794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:49.734794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:49.734794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:49.734794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:49.734794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:49.734794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:49.734794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:49.734794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:02:49.734794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:02:49.734794 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:49.739183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:49.740414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:02:49.740414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:02:49.740414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:49.740414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:02:49.740414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 437/845] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:49.741703 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed477941-4fda-402b-824b-54c1b926e36b None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:49.856326 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed477941-4fda-402b-824b-54c1b926e36b None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:49.891459 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b962f-1d53-43b9-a57a-bd278b479197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:49.892150 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b962f-1d53-43b9-a57a-bd278b479197 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:49.892436 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b962f-1d53-43b9-a57a-bd278b479197 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:49.892709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b962f-1d53-43b9-a57a-bd278b479197 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:49.893426 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b962f-1d53-43b9-a57a-bd278b479197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:49.893731 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b962f-1d53-43b9-a57a-bd278b479197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:49.895291 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b962f-1d53-43b9-a57a-bd278b479197 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:49.907532 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 409/846] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:49.913209 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f1496-b52b-4ad4-a5d7-4385dc1011da None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:50.010729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f1496-b52b-4ad4-a5d7-4385dc1011da None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:50.042143 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d261261-4563-4dad-9c17-e912c84e5c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:50.042930 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d261261-4563-4dad-9c17-e912c84e5c0b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:50.043208 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d261261-4563-4dad-9c17-e912c84e5c0b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:50.043512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d261261-4563-4dad-9c17-e912c84e5c0b None admin] PATH_INFO: `/v3/users/placement` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:50.051714 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d261261-4563-4dad-9c17-e912c84e5c0b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:50.053280 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d261261-4563-4dad-9c17-e912c84e5c0b None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-9d261261-4563-4dad-9c17-e912c84e5c0b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:02:50.067536 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:50.073918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:50.075062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:50.075062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:50.075062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:02:50.075062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:02:50.075062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:02:50.075062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:02:50.075062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:02:50.075062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:02:50.075062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 29 20:02:50.075062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:02:50.075062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 438/847] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:02:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:50.075769 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b962f-1d53-43b9-a57a-bd278b479197 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:50.174540 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b962f-1d53-43b9-a57a-bd278b479197 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:50.207146 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce043a4d-c69f-451f-be36-6b57f572b4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:50.207797 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce043a4d-c69f-451f-be36-6b57f572b4e7 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:50.208115 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce043a4d-c69f-451f-be36-6b57f572b4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:50.208395 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce043a4d-c69f-451f-be36-6b57f572b4e7 None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:50.209211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce043a4d-c69f-451f-be36-6b57f572b4e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:50.209512 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce043a4d-c69f-451f-be36-6b57f572b4e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:50.210959 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce043a4d-c69f-451f-be36-6b57f572b4e7 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:50.227397 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 410/848] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Apr 29 20:02:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:50.233759 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d261261-4563-4dad-9c17-e912c84e5c0b None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:50.328163 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d261261-4563-4dad-9c17-e912c84e5c0b None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:50.360231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a6955-ea59-4d79-874f-2b0d9c69f33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:50.361044 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a6955-ea59-4d79-874f-2b0d9c69f33c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:50.361299 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a6955-ea59-4d79-874f-2b0d9c69f33c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:50.361571 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a6955-ea59-4d79-874f-2b0d9c69f33c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:50.372406 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a6955-ea59-4d79-874f-2b0d9c69f33c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:50.373847 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a6955-ea59-4d79-874f-2b0d9c69f33c None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:50.390223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-ed7a6955-ea59-4d79-874f-2b0d9c69f33c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:50.390223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:50.390223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:50.390223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:50.390223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:50.390223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:50.390223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:50.390223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:50.390223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:50.390223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:50.390223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:50.390223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:50.390223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:02:50.390223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:02:50.390223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:50.391303 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:50.392427 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:02:50.392427 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:02:50.392427 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:50.392427 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:02:50.392427 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 439/849] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:50.397085 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce043a4d-c69f-451f-be36-6b57f572b4e7 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:50.491991 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce043a4d-c69f-451f-be36-6b57f572b4e7 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:50.522932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2077b17-4c2d-449f-952e-af839ef9a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:50.523580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2077b17-4c2d-449f-952e-af839ef9a55a None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:50.523862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2077b17-4c2d-449f-952e-af839ef9a55a None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:50.524164 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2077b17-4c2d-449f-952e-af839ef9a55a None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:50.524872 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2077b17-4c2d-449f-952e-af839ef9a55a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:50.525172 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2077b17-4c2d-449f-952e-af839ef9a55a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:50.527038 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2077b17-4c2d-449f-952e-af839ef9a55a None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:50.537854 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 411/850] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:50.544315 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a6955-ea59-4d79-874f-2b0d9c69f33c None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:50.639506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a6955-ea59-4d79-874f-2b0d9c69f33c None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:50.672615 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c492247-c28b-4a0d-9dc7-935f5ca16dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:50.673499 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c492247-c28b-4a0d-9dc7-935f5ca16dbc None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:50.673771 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c492247-c28b-4a0d-9dc7-935f5ca16dbc None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:50.674034 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c492247-c28b-4a0d-9dc7-935f5ca16dbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:50.680686 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c492247-c28b-4a0d-9dc7-935f5ca16dbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:50.682125 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c492247-c28b-4a0d-9dc7-935f5ca16dbc None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:50.695708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-6c492247-c28b-4a0d-9dc7-935f5ca16dbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:02:50.695708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:50.695708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:50.695708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:50.695708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:50.695708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:50.695708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:50.695708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:50.695708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:50.695708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:50.695708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:50.695708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:50.695708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:02:50.695708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:02:50.695708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:50.696825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:50.697809 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:02:50.697809 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:02:50.697809 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:02:50.697809 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:02:50.697809 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:02:50.697809 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:02:50.697809 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:02:50.697809 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:02:50.697809 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 440/851] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:50.702929 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2077b17-4c2d-449f-952e-af839ef9a55a None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:50.798036 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2077b17-4c2d-449f-952e-af839ef9a55a None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:50.829267 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91a069-c6fe-4fd9-8ebe-ca64bab0dd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:50.829910 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91a069-c6fe-4fd9-8ebe-ca64bab0dd95 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:50.830189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91a069-c6fe-4fd9-8ebe-ca64bab0dd95 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:50.830459 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91a069-c6fe-4fd9-8ebe-ca64bab0dd95 None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:50.831226 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91a069-c6fe-4fd9-8ebe-ca64bab0dd95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:50.831529 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91a069-c6fe-4fd9-8ebe-ca64bab0dd95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:50.832977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91a069-c6fe-4fd9-8ebe-ca64bab0dd95 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:50.844988 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 412/852] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:02:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:50.851444 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c492247-c28b-4a0d-9dc7-935f5ca16dbc None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:50.945595 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c492247-c28b-4a0d-9dc7-935f5ca16dbc None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:50.978379 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd44263-ebf7-4b19-9544-cb1e29c86cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:50.979295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd44263-ebf7-4b19-9544-cb1e29c86cb2 None admin] REQUEST_METHOD: `PUT` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:50.979568 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd44263-ebf7-4b19-9544-cb1e29c86cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:50.979835 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd44263-ebf7-4b19-9544-cb1e29c86cb2 None admin] PATH_INFO: `/v3/projects/d13e73e4e3bf4143b30c02ccf7e1a13c/users/1d4caa8120a44bc79044e1459759ce4a/roles/30572a63e8c84c0fb551e6f8ea95564a` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:50.993309 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd44263-ebf7-4b19-9544-cb1e29c86cb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d13e73e4e3bf4143b30c02ccf7e1a13c, user_id=1d4caa8120a44bc79044e1459759ce4a, role_id=30572a63e8c84c0fb551e6f8ea95564a)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:50.994825 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd44263-ebf7-4b19-9544-cb1e29c86cb2 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:51.147553 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 441/853] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 20:02:50 2022] PUT /identity/v3/projects/d13e73e4e3bf4143b30c02ccf7e1a13c/users/1d4caa8120a44bc79044e1459759ce4a/roles/30572a63e8c84c0fb551e6f8ea95564a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:02:53.457592 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fbff7-1c5c-4bea-ade7-9f60fac77ecc None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:53.458134 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fbff7-1c5c-4bea-ade7-9f60fac77ecc None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:53.458134 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fbff7-1c5c-4bea-ade7-9f60fac77ecc None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:53.459626 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 413/854] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:02:53.465484 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2efa27-76b3-418e-b870-7cde23a46bf9 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:53.465956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2efa27-76b3-418e-b870-7cde23a46bf9 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:53.466059 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2efa27-76b3-418e-b870-7cde23a46bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:53.482898 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-dc2efa27-76b3-418e-b870-7cde23a46bf9 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:02:53.484131 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-dc2efa27-76b3-418e-b870-7cde23a46bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:02:53.546384 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 442/855] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:02:53 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:02:53.571079 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fbff7-1c5c-4bea-ade7-9f60fac77ecc None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:53.668905 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fbff7-1c5c-4bea-ade7-9f60fac77ecc None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:53.700946 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba828cf-ad0d-4471-ac19-98e246c8afb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:53.701739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba828cf-ad0d-4471-ac19-98e246c8afb0 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:53.702022 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba828cf-ad0d-4471-ac19-98e246c8afb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:53.702295 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba828cf-ad0d-4471-ac19-98e246c8afb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:53.712050 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba828cf-ad0d-4471-ac19-98e246c8afb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-0ba828cf-ad0d-4471-ac19-98e246c8afb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:02:53.720241 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:53.721420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:53.722468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:53.722468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:53.722468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:53.722468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:53.722468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:02:53.722468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:02:53.722468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:02:53.722468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:02:53.722468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:02:53.722468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:02:53.722468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 29 20:02:53.722468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:02:53.722468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 414/856] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Apr 29 20:02:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:53.727915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2efa27-76b3-418e-b870-7cde23a46bf9 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:53.823510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2efa27-76b3-418e-b870-7cde23a46bf9 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:53.856265 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05828de7-95b0-464c-a9ff-023dd7da1e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:53.856947 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05828de7-95b0-464c-a9ff-023dd7da1e23 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:53.857208 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05828de7-95b0-464c-a9ff-023dd7da1e23 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:53.857477 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05828de7-95b0-464c-a9ff-023dd7da1e23 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:53.858206 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05828de7-95b0-464c-a9ff-023dd7da1e23 None admin] RBAC: Adding query filter params (name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:53.858505 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05828de7-95b0-464c-a9ff-023dd7da1e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:53.859859 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05828de7-95b0-464c-a9ff-023dd7da1e23 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:53.867399 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 443/857] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Apr 29 20:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:53.873141 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba828cf-ad0d-4471-ac19-98e246c8afb0 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:53.969115 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba828cf-ad0d-4471-ac19-98e246c8afb0 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:54.000201 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d86c3-b2c0-4c61-9ff6-9633a2d9f3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:54.001027 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d86c3-b2c0-4c61-9ff6-9633a2d9f3a3 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:54.001301 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d86c3-b2c0-4c61-9ff6-9633a2d9f3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:54.001570 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d86c3-b2c0-4c61-9ff6-9633a2d9f3a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:54.012366 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d86c3-b2c0-4c61-9ff6-9633a2d9f3a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:54.013874 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d86c3-b2c0-4c61-9ff6-9633a2d9f3a3 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:54.030995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-b91d86c3-b2c0-4c61-9ff6-9633a2d9f3a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:54.030995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:54.030995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:54.030995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:54.030995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:54.030995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:54.030995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:54.030995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:54.030995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:54.030995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:54.030995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:54.030995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:54.030995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:02:54.030995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:02:54.030995 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:54.032046 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:54.033044 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:02:54.033044 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:02:54.033044 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:54.033044 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:02:54.033044 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 415/858] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:54.038187 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05828de7-95b0-464c-a9ff-023dd7da1e23 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:54.132786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05828de7-95b0-464c-a9ff-023dd7da1e23 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:54.165109 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a48c0-54c0-467f-aeae-8032a82f3b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:54.165761 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a48c0-54c0-467f-aeae-8032a82f3b46 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:54.166040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a48c0-54c0-467f-aeae-8032a82f3b46 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:54.166341 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a48c0-54c0-467f-aeae-8032a82f3b46 None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:54.167069 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a48c0-54c0-467f-aeae-8032a82f3b46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:54.167355 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a48c0-54c0-467f-aeae-8032a82f3b46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:54.168767 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a48c0-54c0-467f-aeae-8032a82f3b46 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:54.179854 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 444/859] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:54.186075 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d86c3-b2c0-4c61-9ff6-9633a2d9f3a3 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:54.281228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d86c3-b2c0-4c61-9ff6-9633a2d9f3a3 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:54.313276 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bff2fe-0bb5-4e38-969a-907b93abc813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:54.316926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bff2fe-0bb5-4e38-969a-907b93abc813 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:54.316926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bff2fe-0bb5-4e38-969a-907b93abc813 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:54.316926 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bff2fe-0bb5-4e38-969a-907b93abc813 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:54.321759 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bff2fe-0bb5-4e38-969a-907b93abc813 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:54.323809 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bff2fe-0bb5-4e38-969a-907b93abc813 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-07bff2fe-0bb5-4e38-969a-907b93abc813 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:02:54.337693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:54.338758 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:54.339803 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:54.339803 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:54.339803 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:02:54.339803 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:02:54.339803 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:02:54.339803 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:02:54.339803 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:02:54.339803 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:02:54.339803 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 29 20:02:54.339803 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:02:54.339803 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 416/860] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:02:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:54.344800 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a48c0-54c0-467f-aeae-8032a82f3b46 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:54.439312 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a48c0-54c0-467f-aeae-8032a82f3b46 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:54.471489 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0fa9f-f5f9-4ed8-a26e-7c7ce2a0e0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:54.472199 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0fa9f-f5f9-4ed8-a26e-7c7ce2a0e0ea None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:54.472446 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0fa9f-f5f9-4ed8-a26e-7c7ce2a0e0ea None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:54.472716 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0fa9f-f5f9-4ed8-a26e-7c7ce2a0e0ea None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:54.473539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0fa9f-f5f9-4ed8-a26e-7c7ce2a0e0ea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:54.473844 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0fa9f-f5f9-4ed8-a26e-7c7ce2a0e0ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:54.475265 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0fa9f-f5f9-4ed8-a26e-7c7ce2a0e0ea None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:54.492013 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 445/861] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Apr 29 20:02:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:54.498329 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bff2fe-0bb5-4e38-969a-907b93abc813 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:54.596042 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bff2fe-0bb5-4e38-969a-907b93abc813 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:54.628035 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331bc09-951f-4661-b28b-37a158b9fb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:54.628783 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331bc09-951f-4661-b28b-37a158b9fb7e None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:54.629060 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331bc09-951f-4661-b28b-37a158b9fb7e None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:54.629331 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331bc09-951f-4661-b28b-37a158b9fb7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:54.693816 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331bc09-951f-4661-b28b-37a158b9fb7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:54.695301 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331bc09-951f-4661-b28b-37a158b9fb7e None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:54.787894 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 417/862] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:02:54 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 20:02:54.794258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0fa9f-f5f9-4ed8-a26e-7c7ce2a0e0ea None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:54.890922 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0fa9f-f5f9-4ed8-a26e-7c7ce2a0e0ea None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:54.923141 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50706010-6804-41dd-921a-a4b207421779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:54.923844 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706010-6804-41dd-921a-a4b207421779 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:54.924150 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706010-6804-41dd-921a-a4b207421779 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:54.924420 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706010-6804-41dd-921a-a4b207421779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:54.934557 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50706010-6804-41dd-921a-a4b207421779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:54.936158 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50706010-6804-41dd-921a-a4b207421779 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:54.953063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-50706010-6804-41dd-921a-a4b207421779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:54.953063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:54.953063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:54.953063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:54.953063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:54.953063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:54.953063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:54.953063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:54.953063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:54.953063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:54.953063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:54.953063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:54.953063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:02:54.953063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:02:54.953063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:54.954110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:54.955370 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:02:54.955370 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:02:54.955370 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:54.955370 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:02:54.955370 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 446/863] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:54.959932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331bc09-951f-4661-b28b-37a158b9fb7e None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:55.052567 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331bc09-951f-4661-b28b-37a158b9fb7e None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:55.083744 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b63f17-08b4-4153-b699-82f88b9d8561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:55.084411 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b63f17-08b4-4153-b699-82f88b9d8561 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:55.084688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b63f17-08b4-4153-b699-82f88b9d8561 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:55.084957 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b63f17-08b4-4153-b699-82f88b9d8561 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:55.085658 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b63f17-08b4-4153-b699-82f88b9d8561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:55.085955 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b63f17-08b4-4153-b699-82f88b9d8561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:55.087357 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b63f17-08b4-4153-b699-82f88b9d8561 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:55.098294 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 418/864] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:55.104685 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50706010-6804-41dd-921a-a4b207421779 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:55.198089 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50706010-6804-41dd-921a-a4b207421779 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:55.231893 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6178e-bab8-419c-a061-88e6317d3ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:55.232621 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6178e-bab8-419c-a061-88e6317d3ad8 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:55.232905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6178e-bab8-419c-a061-88e6317d3ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:55.233166 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6178e-bab8-419c-a061-88e6317d3ad8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:55.239807 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6178e-bab8-419c-a061-88e6317d3ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:55.241275 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6178e-bab8-419c-a061-88e6317d3ad8 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:55.254527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-04c6178e-bab8-419c-a061-88e6317d3ad8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:02:55.254527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:55.254527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:55.254527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:55.254527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:55.254527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:55.254527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:55.254527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:55.254527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:55.254527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:55.254527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:55.254527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:55.254527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:02:55.254527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:02:55.254527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:55.256620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:55.257682 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:02:55.257682 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:02:55.257682 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:02:55.257682 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:02:55.257682 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:02:55.257682 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:02:55.257682 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:02:55.257682 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:02:55.257682 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 447/865] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:55.261799 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b63f17-08b4-4153-b699-82f88b9d8561 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:55.358031 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b63f17-08b4-4153-b699-82f88b9d8561 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:55.389871 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354d9ae-270f-4c67-9029-3967eedf9716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:55.390518 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354d9ae-270f-4c67-9029-3967eedf9716 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:55.390805 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354d9ae-270f-4c67-9029-3967eedf9716 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:55.391075 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354d9ae-270f-4c67-9029-3967eedf9716 None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:55.391844 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354d9ae-270f-4c67-9029-3967eedf9716 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:55.392192 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354d9ae-270f-4c67-9029-3967eedf9716 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:55.393612 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354d9ae-270f-4c67-9029-3967eedf9716 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:55.405662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 419/866] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:55.411793 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6178e-bab8-419c-a061-88e6317d3ad8 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:55.505645 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6178e-bab8-419c-a061-88e6317d3ad8 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:55.537969 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e2cea-f03d-439b-b7bf-5782a729102b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:55.538608 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e2cea-f03d-439b-b7bf-5782a729102b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:55.538884 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e2cea-f03d-439b-b7bf-5782a729102b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:55.539177 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e2cea-f03d-439b-b7bf-5782a729102b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:55.540011 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e2cea-f03d-439b-b7bf-5782a729102b None admin] RBAC: Adding query filter params (role.id=30572a63e8c84c0fb551e6f8ea95564a, scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c, user.id=1d4caa8120a44bc79044e1459759ce4a) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:55.540315 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e2cea-f03d-439b-b7bf-5782a729102b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:55.541763 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e2cea-f03d-439b-b7bf-5782a729102b None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:55.547272 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 448/867] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:02:55 2022] GET /identity/v3/role_assignments?user.id=1d4caa8120a44bc79044e1459759ce4a&scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c&role.id=30572a63e8c84c0fb551e6f8ea95564a => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:57.885734 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a68c66-5807-4def-b4a0-e9531bb42cbf None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:57.886268 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a68c66-5807-4def-b4a0-e9531bb42cbf None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:57.886268 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a68c66-5807-4def-b4a0-e9531bb42cbf None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:57.887716 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 420/868] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:02:57.893169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123564cb-81f4-45e7-88bc-0151357e6b36 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:57.893587 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123564cb-81f4-45e7-88bc-0151357e6b36 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:57.893892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123564cb-81f4-45e7-88bc-0151357e6b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:57.910505 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-123564cb-81f4-45e7-88bc-0151357e6b36 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:02:57.912730 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-123564cb-81f4-45e7-88bc-0151357e6b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:02:57.978057 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 449/869] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:02:57 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:02:58.003378 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a68c66-5807-4def-b4a0-e9531bb42cbf None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:58.098805 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a68c66-5807-4def-b4a0-e9531bb42cbf None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:58.131252 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdb2cd-9ec3-4bb3-9392-2f82cdb33236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:58.132153 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdb2cd-9ec3-4bb3-9392-2f82cdb33236 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:58.132435 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdb2cd-9ec3-4bb3-9392-2f82cdb33236 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:58.132710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdb2cd-9ec3-4bb3-9392-2f82cdb33236 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:58.142762 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdb2cd-9ec3-4bb3-9392-2f82cdb33236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-a5bdb2cd-9ec3-4bb3-9392-2f82cdb33236 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:02:58.151160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:58.152283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:58.153340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:58.153340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:58.153340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:58.153340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:58.153340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:02:58.153340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:02:58.153340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:02:58.153340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:02:58.153340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:02:58.153340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:02:58.153340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:02:58.153340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:02:58.153340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 421/870] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 20:02:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:58.158419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123564cb-81f4-45e7-88bc-0151357e6b36 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:58.253330 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123564cb-81f4-45e7-88bc-0151357e6b36 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:58.286286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2733530-36c0-46bb-aa20-ba8e48df612d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:58.287037 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2733530-36c0-46bb-aa20-ba8e48df612d None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:58.287319 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2733530-36c0-46bb-aa20-ba8e48df612d None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:58.287596 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2733530-36c0-46bb-aa20-ba8e48df612d None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:58.288362 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2733530-36c0-46bb-aa20-ba8e48df612d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:58.288667 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2733530-36c0-46bb-aa20-ba8e48df612d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:58.290032 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2733530-36c0-46bb-aa20-ba8e48df612d None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:58.298586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 450/871] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:02:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:58.304335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdb2cd-9ec3-4bb3-9392-2f82cdb33236 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:58.399402 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdb2cd-9ec3-4bb3-9392-2f82cdb33236 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:58.430822 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b7de4-f2e0-4ef2-9a0d-52fab10e63b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:58.431619 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b7de4-f2e0-4ef2-9a0d-52fab10e63b4 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:58.431919 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b7de4-f2e0-4ef2-9a0d-52fab10e63b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:58.432435 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b7de4-f2e0-4ef2-9a0d-52fab10e63b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:58.444795 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b7de4-f2e0-4ef2-9a0d-52fab10e63b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:58.446218 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b7de4-f2e0-4ef2-9a0d-52fab10e63b4 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:58.463641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-2c2b7de4-f2e0-4ef2-9a0d-52fab10e63b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:58.463641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:58.463641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:58.463641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:58.463641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:58.463641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:58.463641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:58.463641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:58.463641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:58.463641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:58.463641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:58.463641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:58.463641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:02:58.463641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:02:58.463641 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:58.464711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:58.465853 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:02:58.465853 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:02:58.465853 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:58.465853 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:02:58.465853 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 422/872] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:58.470709 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2733530-36c0-46bb-aa20-ba8e48df612d None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:58.567043 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2733530-36c0-46bb-aa20-ba8e48df612d None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:58.598650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b3cfa-0ecb-4212-9bd9-756d51475cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:58.599304 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b3cfa-0ecb-4212-9bd9-756d51475cd8 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:58.599613 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b3cfa-0ecb-4212-9bd9-756d51475cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:58.599887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b3cfa-0ecb-4212-9bd9-756d51475cd8 None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:58.600627 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b3cfa-0ecb-4212-9bd9-756d51475cd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:58.601185 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b3cfa-0ecb-4212-9bd9-756d51475cd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:58.602551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b3cfa-0ecb-4212-9bd9-756d51475cd8 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:58.614665 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 451/873] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:58.620864 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b7de4-f2e0-4ef2-9a0d-52fab10e63b4 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:58.715584 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b7de4-f2e0-4ef2-9a0d-52fab10e63b4 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:58.747853 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9918a8-b802-43d9-a69d-8fd59c386e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:58.748671 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9918a8-b802-43d9-a69d-8fd59c386e79 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:58.748979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9918a8-b802-43d9-a69d-8fd59c386e79 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:58.749223 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9918a8-b802-43d9-a69d-8fd59c386e79 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:58.756467 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9918a8-b802-43d9-a69d-8fd59c386e79 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:58.757924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9918a8-b802-43d9-a69d-8fd59c386e79 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-5f9918a8-b802-43d9-a69d-8fd59c386e79 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:02:58.772131 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:58.778690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:58.779649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:58.779649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:58.779649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:02:58.779649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:02:58.779649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:02:58.779649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:02:58.779649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:02:58.779649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:02:58.779649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 29 20:02:58.779649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:02:58.779649 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 423/874] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:02:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:58.780756 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b3cfa-0ecb-4212-9bd9-756d51475cd8 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:58.874662 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b3cfa-0ecb-4212-9bd9-756d51475cd8 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:58.907150 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02fcca-b6a8-495e-8b79-2ba1520c77d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:58.907809 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02fcca-b6a8-495e-8b79-2ba1520c77d8 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:58.908235 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02fcca-b6a8-495e-8b79-2ba1520c77d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:58.908508 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02fcca-b6a8-495e-8b79-2ba1520c77d8 None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:58.909317 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02fcca-b6a8-495e-8b79-2ba1520c77d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:58.909616 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02fcca-b6a8-495e-8b79-2ba1520c77d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:58.911011 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02fcca-b6a8-495e-8b79-2ba1520c77d8 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:58.928380 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 452/875] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Apr 29 20:02:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:58.934357 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9918a8-b802-43d9-a69d-8fd59c386e79 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:59.034240 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9918a8-b802-43d9-a69d-8fd59c386e79 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:59.066023 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f86f5-0531-46e7-b720-1fa1389e9cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:59.066654 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f86f5-0531-46e7-b720-1fa1389e9cf1 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:59.066935 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f86f5-0531-46e7-b720-1fa1389e9cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:59.067202 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f86f5-0531-46e7-b720-1fa1389e9cf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:59.131465 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f86f5-0531-46e7-b720-1fa1389e9cf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:59.132977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f86f5-0531-46e7-b720-1fa1389e9cf1 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:59.225271 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 424/876] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:02:58 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 20:02:59.232060 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02fcca-b6a8-495e-8b79-2ba1520c77d8 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:59.328344 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02fcca-b6a8-495e-8b79-2ba1520c77d8 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:59.361888 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da804252-bcb6-4704-a322-59472002f580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:59.362817 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da804252-bcb6-4704-a322-59472002f580 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:59.363097 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da804252-bcb6-4704-a322-59472002f580 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:59.363382 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da804252-bcb6-4704-a322-59472002f580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:59.373638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da804252-bcb6-4704-a322-59472002f580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:59.375084 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da804252-bcb6-4704-a322-59472002f580 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:59.393238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-da804252-bcb6-4704-a322-59472002f580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:59.393238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:59.393238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:59.393238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:59.393238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:59.393238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:59.393238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:59.393238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:59.393238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:59.393238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:59.393238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:59.393238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:59.393238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:02:59.393238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:02:59.393238 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:59.394271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:59.395514 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:02:59.395514 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:02:59.395514 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:02:59.395514 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:02:59.395514 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 453/877] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:59.400184 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f86f5-0531-46e7-b720-1fa1389e9cf1 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:59.494000 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f86f5-0531-46e7-b720-1fa1389e9cf1 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:59.526551 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4619f-8668-4a8b-a73e-997714cad965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:59.527201 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4619f-8668-4a8b-a73e-997714cad965 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:59.527485 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4619f-8668-4a8b-a73e-997714cad965 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:59.527760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4619f-8668-4a8b-a73e-997714cad965 None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:59.528502 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4619f-8668-4a8b-a73e-997714cad965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:59.528892 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4619f-8668-4a8b-a73e-997714cad965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:59.530376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4619f-8668-4a8b-a73e-997714cad965 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:59.541461 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 425/878] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:02:59.547131 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da804252-bcb6-4704-a322-59472002f580 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:59.643605 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da804252-bcb6-4704-a322-59472002f580 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:59.675775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983ae8e-5378-4e44-ae63-59b435fd0f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:59.676598 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983ae8e-5378-4e44-ae63-59b435fd0f34 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:59.676875 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983ae8e-5378-4e44-ae63-59b435fd0f34 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:59.677146 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983ae8e-5378-4e44-ae63-59b435fd0f34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:59.684136 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983ae8e-5378-4e44-ae63-59b435fd0f34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:59.685581 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983ae8e-5378-4e44-ae63-59b435fd0f34 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:59.699512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-2983ae8e-5378-4e44-ae63-59b435fd0f34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:02:59.699512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:02:59.699512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:02:59.699512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:02:59.699512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:02:59.699512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:02:59.699512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:02:59.699512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:02:59.699512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:02:59.699512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:02:59.699512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:02:59.699512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:02:59.699512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:02:59.699512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:02:59.699512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:02:59.701107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:02:59.702047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:02:59.702047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:02:59.702047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:02:59.702047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:02:59.702047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:02:59.702047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:02:59.702047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:02:59.702047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:02:59.702047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 454/879] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:02:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:02:59.706588 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4619f-8668-4a8b-a73e-997714cad965 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:59.801069 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4619f-8668-4a8b-a73e-997714cad965 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:59.833033 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05429cbe-d7d1-4bb8-8e97-51a0da1b5494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:59.833682 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05429cbe-d7d1-4bb8-8e97-51a0da1b5494 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:59.833959 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05429cbe-d7d1-4bb8-8e97-51a0da1b5494 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:59.834228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05429cbe-d7d1-4bb8-8e97-51a0da1b5494 None admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:59.834998 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05429cbe-d7d1-4bb8-8e97-51a0da1b5494 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:59.835302 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05429cbe-d7d1-4bb8-8e97-51a0da1b5494 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:59.836817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05429cbe-d7d1-4bb8-8e97-51a0da1b5494 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:59.848356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 426/880] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:02:59.855403 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983ae8e-5378-4e44-ae63-59b435fd0f34 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:02:59.949629 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983ae8e-5378-4e44-ae63-59b435fd0f34 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:02:59.981069 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0d561-8873-4084-b3ee-e9ce226dedb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:02:59.981699 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0d561-8873-4084-b3ee-e9ce226dedb6 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:02:59.981970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0d561-8873-4084-b3ee-e9ce226dedb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:02:59.982234 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0d561-8873-4084-b3ee-e9ce226dedb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:02:59.983040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0d561-8873-4084-b3ee-e9ce226dedb6 None admin] RBAC: Adding query filter params (role.id=5255ed3fa613448fb4c549f5bc7f20af, scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c, user.id=1d4caa8120a44bc79044e1459759ce4a) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:02:59.983342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0d561-8873-4084-b3ee-e9ce226dedb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:02:59.984814 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0d561-8873-4084-b3ee-e9ce226dedb6 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:02:59.989915 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 455/881] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:02:59 2022] GET /identity/v3/role_assignments?user.id=1d4caa8120a44bc79044e1459759ce4a&scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c&role.id=5255ed3fa613448fb4c549f5bc7f20af => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:03:02.264546 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57af4fe-a818-4032-ab64-ac12c0267686 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:02.265127 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57af4fe-a818-4032-ab64-ac12c0267686 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:02.265127 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57af4fe-a818-4032-ab64-ac12c0267686 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:02.266447 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 427/882] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:03:02.271681 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fff2e7-3cc8-419f-a710-e0e44e48dfa8 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:02.272105 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fff2e7-3cc8-419f-a710-e0e44e48dfa8 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:02.272253 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fff2e7-3cc8-419f-a710-e0e44e48dfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:02.288877 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-12fff2e7-3cc8-419f-a710-e0e44e48dfa8 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:03:02.290007 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-12fff2e7-3cc8-419f-a710-e0e44e48dfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:03:02.353034 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 456/883] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:03:02 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:03:02.375850 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57af4fe-a818-4032-ab64-ac12c0267686 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:02.472768 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57af4fe-a818-4032-ab64-ac12c0267686 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:02.505262 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a913c94-7bad-4d50-aac0-4b4afbc6517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:02.506060 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a913c94-7bad-4d50-aac0-4b4afbc6517b None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:02.506340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a913c94-7bad-4d50-aac0-4b4afbc6517b None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:02.506610 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a913c94-7bad-4d50-aac0-4b4afbc6517b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:02.517270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a913c94-7bad-4d50-aac0-4b4afbc6517b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-7a913c94-7bad-4d50-aac0-4b4afbc6517b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:03:02.524913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:03:02.525838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:03:02.526693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:03:02.526693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:03:02.526693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:03:02.526693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:03:02.526693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:03:02.526693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:03:02.526693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:03:02.526693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:03:02.526693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:03:02.526693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:03:02.526693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:03:02.526693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:03:02.526693 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 428/884] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 20:03:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:03:02.532239 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fff2e7-3cc8-419f-a710-e0e44e48dfa8 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:02.626114 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fff2e7-3cc8-419f-a710-e0e44e48dfa8 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:02.658084 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11d4aa-fa6b-4c18-aa12-bff1836cc8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:02.658737 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11d4aa-fa6b-4c18-aa12-bff1836cc8d8 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:02.659015 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11d4aa-fa6b-4c18-aa12-bff1836cc8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:02.659289 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11d4aa-fa6b-4c18-aa12-bff1836cc8d8 None admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:02.660037 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11d4aa-fa6b-4c18-aa12-bff1836cc8d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:02.660337 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11d4aa-fa6b-4c18-aa12-bff1836cc8d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:02.661701 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11d4aa-fa6b-4c18-aa12-bff1836cc8d8 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:02.669573 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 457/885] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:03:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:03:02.675398 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a913c94-7bad-4d50-aac0-4b4afbc6517b None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:02.772095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a913c94-7bad-4d50-aac0-4b4afbc6517b None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:02.804044 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792fa78-cb4d-476c-bff8-09188af31fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:02.804825 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792fa78-cb4d-476c-bff8-09188af31fa7 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:02.805101 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792fa78-cb4d-476c-bff8-09188af31fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:02.805370 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792fa78-cb4d-476c-bff8-09188af31fa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:02.816621 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792fa78-cb4d-476c-bff8-09188af31fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:02.818083 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792fa78-cb4d-476c-bff8-09188af31fa7 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:02.835428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-e792fa78-cb4d-476c-bff8-09188af31fa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:03:02.835428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:02.835428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:03:02.835428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:03:02.835428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:03:02.835428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:03:02.835428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:03:02.835428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:03:02.835428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:03:02.835428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:03:02.835428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:03:02.835428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:03:02.835428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:03:02.835428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:03:02.835428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:03:02.836386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:03:02.837375 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:03:02.837375 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:03:02.837375 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:03:02.837375 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:03:02.837375 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 429/886] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:03:02.843150 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11d4aa-fa6b-4c18-aa12-bff1836cc8d8 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:02.939052 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11d4aa-fa6b-4c18-aa12-bff1836cc8d8 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:02.970929 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d1871-ede5-4e58-bfa2-1318bb3e08c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:02.971582 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1871-ede5-4e58-bfa2-1318bb3e08c7 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:02.971857 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1871-ede5-4e58-bfa2-1318bb3e08c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:02.972152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1871-ede5-4e58-bfa2-1318bb3e08c7 None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:02.972852 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d1871-ede5-4e58-bfa2-1318bb3e08c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:02.973151 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d1871-ede5-4e58-bfa2-1318bb3e08c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:02.974506 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d1871-ede5-4e58-bfa2-1318bb3e08c7 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:02.985702 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 458/887] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:03:02.991588 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792fa78-cb4d-476c-bff8-09188af31fa7 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:03.087820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792fa78-cb4d-476c-bff8-09188af31fa7 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:03.119867 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec62a7c-ace5-4248-a026-0857b624189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:03.120688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec62a7c-ace5-4248-a026-0857b624189e None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:03.120968 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec62a7c-ace5-4248-a026-0857b624189e None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:03.121240 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec62a7c-ace5-4248-a026-0857b624189e None admin] PATH_INFO: `/v3/users/placement` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:03.128292 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec62a7c-ace5-4248-a026-0857b624189e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:03.129766 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec62a7c-ace5-4248-a026-0857b624189e None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-4ec62a7c-ace5-4248-a026-0857b624189e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:03:03.144273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:03:03.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:03:03.146504 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:03:03.146504 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:03:03.146504 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:03:03.146504 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:03:03.146504 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:03:03.146504 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:03:03.146504 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:03:03.146504 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:03:03.146504 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 29 20:03:03.146504 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:03:03.146504 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 430/888] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:03:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:03:03.151876 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d1871-ede5-4e58-bfa2-1318bb3e08c7 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:03.249970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d1871-ede5-4e58-bfa2-1318bb3e08c7 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:03.288624 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f77d4b-3ce6-4e25-8d3d-8b654fd3f633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:03.289280 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f77d4b-3ce6-4e25-8d3d-8b654fd3f633 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:03.289551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f77d4b-3ce6-4e25-8d3d-8b654fd3f633 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:03.289819 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f77d4b-3ce6-4e25-8d3d-8b654fd3f633 None admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:03.290644 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f77d4b-3ce6-4e25-8d3d-8b654fd3f633 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:03.290946 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f77d4b-3ce6-4e25-8d3d-8b654fd3f633 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:03.292449 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f77d4b-3ce6-4e25-8d3d-8b654fd3f633 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:03.309287 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 459/889] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Apr 29 20:03:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:03:03.314867 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec62a7c-ace5-4248-a026-0857b624189e None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:03.410502 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec62a7c-ace5-4248-a026-0857b624189e None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:03.442667 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad154cc0-7f23-4cc3-b335-22f1ca9c16e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:03.443535 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad154cc0-7f23-4cc3-b335-22f1ca9c16e4 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:03.443820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad154cc0-7f23-4cc3-b335-22f1ca9c16e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:03.444126 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad154cc0-7f23-4cc3-b335-22f1ca9c16e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:03.455164 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad154cc0-7f23-4cc3-b335-22f1ca9c16e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:03.456642 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad154cc0-7f23-4cc3-b335-22f1ca9c16e4 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:03.473071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-ad154cc0-7f23-4cc3-b335-22f1ca9c16e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:03:03.473071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:03.473071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:03:03.473071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:03:03.473071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:03:03.473071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:03:03.473071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:03:03.473071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:03:03.473071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:03:03.473071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:03:03.473071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:03:03.473071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:03:03.473071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:03:03.473071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:03:03.473071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:03:03.477549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:03:03.478662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:03:03.478662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:03:03.478662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:03:03.478662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:03:03.478662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 431/890] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:03:03.480202 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f77d4b-3ce6-4e25-8d3d-8b654fd3f633 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:03.586777 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f77d4b-3ce6-4e25-8d3d-8b654fd3f633 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:03.626267 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310aaaf4-2589-4eff-b98e-f4dc5a35c74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:03.626830 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310aaaf4-2589-4eff-b98e-f4dc5a35c74c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:03.627104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310aaaf4-2589-4eff-b98e-f4dc5a35c74c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:03.627371 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310aaaf4-2589-4eff-b98e-f4dc5a35c74c None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:03.628106 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310aaaf4-2589-4eff-b98e-f4dc5a35c74c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:03.628407 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310aaaf4-2589-4eff-b98e-f4dc5a35c74c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:03.629773 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310aaaf4-2589-4eff-b98e-f4dc5a35c74c None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:03.640905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 460/891] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:03:03.646597 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad154cc0-7f23-4cc3-b335-22f1ca9c16e4 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:03.742482 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad154cc0-7f23-4cc3-b335-22f1ca9c16e4 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:03.773934 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178f2a-5e6a-4ddb-82a4-6b056a3f453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:03.774706 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178f2a-5e6a-4ddb-82a4-6b056a3f453c None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:03.774980 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178f2a-5e6a-4ddb-82a4-6b056a3f453c None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:03.775247 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178f2a-5e6a-4ddb-82a4-6b056a3f453c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:03.781731 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0178f2a-5e6a-4ddb-82a4-6b056a3f453c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:03.783163 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0178f2a-5e6a-4ddb-82a4-6b056a3f453c None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:03.797607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-c0178f2a-5e6a-4ddb-82a4-6b056a3f453c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:03:03.797607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:03.797607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:03:03.797607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:03:03.797607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:03:03.797607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:03:03.797607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:03:03.797607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:03:03.797607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:03:03.797607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:03:03.797607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:03:03.797607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:03:03.797607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:03:03.797607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:03:03.797607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:03:03.798580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:03:03.799908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:03:03.799908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:03:03.799908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:03:03.799908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:03:03.799908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:03:03.799908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:03:03.799908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:03:03.799908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:03:03.799908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 432/892] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:03:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:03:03.804620 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310aaaf4-2589-4eff-b98e-f4dc5a35c74c None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:03.903998 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310aaaf4-2589-4eff-b98e-f4dc5a35c74c None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:03.936155 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da4703-175f-4ee7-980e-639f7fcd9083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:03.936798 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da4703-175f-4ee7-980e-639f7fcd9083 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:03.937077 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da4703-175f-4ee7-980e-639f7fcd9083 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:03.937349 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da4703-175f-4ee7-980e-639f7fcd9083 None admin] PATH_INFO: `/v3/projects` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:03.938122 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da4703-175f-4ee7-980e-639f7fcd9083 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:03.938426 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da4703-175f-4ee7-980e-639f7fcd9083 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:03.939836 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da4703-175f-4ee7-980e-639f7fcd9083 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:03.951881 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 461/893] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:03:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:03:03.957857 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178f2a-5e6a-4ddb-82a4-6b056a3f453c None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:04.054456 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178f2a-5e6a-4ddb-82a4-6b056a3f453c None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:04.087316 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aebe7d-8bf3-47c5-b12a-de9a4de6f198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:04.088240 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aebe7d-8bf3-47c5-b12a-de9a4de6f198 None admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:04.089019 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aebe7d-8bf3-47c5-b12a-de9a4de6f198 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:04.089290 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aebe7d-8bf3-47c5-b12a-de9a4de6f198 None admin] PATH_INFO: `/v3/projects/d13e73e4e3bf4143b30c02ccf7e1a13c/users/1d4caa8120a44bc79044e1459759ce4a/roles/5255ed3fa613448fb4c549f5bc7f20af` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:04.091246 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aebe7d-8bf3-47c5-b12a-de9a4de6f198 None admin] RBAC: Authorizing `identity:create_grant(project_id=d13e73e4e3bf4143b30c02ccf7e1a13c, user_id=1d4caa8120a44bc79044e1459759ce4a, role_id=5255ed3fa613448fb4c549f5bc7f20af)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:04.092719 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aebe7d-8bf3-47c5-b12a-de9a4de6f198 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:04.242133 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 433/894] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Apr 29 20:03:03 2022] PUT /identity/v3/projects/d13e73e4e3bf4143b30c02ccf7e1a13c/users/1d4caa8120a44bc79044e1459759ce4a/roles/5255ed3fa613448fb4c549f5bc7f20af => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:03:06.572467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17221738-5134-4e4d-9ef1-2a516b251ce5 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:06.573570 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17221738-5134-4e4d-9ef1-2a516b251ce5 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:06.573570 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17221738-5134-4e4d-9ef1-2a516b251ce5 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:06.574959 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 462/895] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:03:06.580280 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb1db8-4933-45f9-acd5-77886338058d None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:06.580726 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb1db8-4933-45f9-acd5-77886338058d None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:06.580817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb1db8-4933-45f9-acd5-77886338058d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:06.596929 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-cccb1db8-4933-45f9-acd5-77886338058d None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:03:06.598056 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-cccb1db8-4933-45f9-acd5-77886338058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:03:06.661881 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 434/896] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:03:06 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:03:06.687149 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17221738-5134-4e4d-9ef1-2a516b251ce5 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:06.784877 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17221738-5134-4e4d-9ef1-2a516b251ce5 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:06.816395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a65050-13f0-44c9-b47e-07222c9bec24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:06.817182 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a65050-13f0-44c9-b47e-07222c9bec24 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:06.817456 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a65050-13f0-44c9-b47e-07222c9bec24 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:06.817724 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a65050-13f0-44c9-b47e-07222c9bec24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:06.827783 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a65050-13f0-44c9-b47e-07222c9bec24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-b1a65050-13f0-44c9-b47e-07222c9bec24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 29 20:03:06.835395 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:03:06.836521 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:03:06.837471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:03:06.837471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:03:06.837471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:03:06.837471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:03:06.837471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 29 20:03:06.837471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 29 20:03:06.837471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 29 20:03:06.837471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 29 20:03:06.837471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 29 20:03:06.837471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 29 20:03:06.837471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 29 20:03:06.837471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:03:06.837471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 463/897] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Apr 29 20:03:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:03:06.843238 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb1db8-4933-45f9-acd5-77886338058d None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:06.937651 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb1db8-4933-45f9-acd5-77886338058d None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:06.969961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e4446-853d-4d32-b879-2d861563424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:06.970624 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e4446-853d-4d32-b879-2d861563424d None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:06.970909 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e4446-853d-4d32-b879-2d861563424d None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:06.971183 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e4446-853d-4d32-b879-2d861563424d None admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:06.971922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e4446-853d-4d32-b879-2d861563424d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:06.972257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e4446-853d-4d32-b879-2d861563424d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:06.973619 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e4446-853d-4d32-b879-2d861563424d None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:06.981810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 435/898] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Apr 29 20:03:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:03:06.987650 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a65050-13f0-44c9-b47e-07222c9bec24 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:07.088213 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a65050-13f0-44c9-b47e-07222c9bec24 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:07.120291 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda133d6-d1c8-4d0e-be19-888df6cd970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:07.121074 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda133d6-d1c8-4d0e-be19-888df6cd970b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:07.121351 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda133d6-d1c8-4d0e-be19-888df6cd970b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:07.121627 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda133d6-d1c8-4d0e-be19-888df6cd970b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:07.131731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda133d6-d1c8-4d0e-be19-888df6cd970b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:07.133210 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda133d6-d1c8-4d0e-be19-888df6cd970b None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:07.150219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-eda133d6-d1c8-4d0e-be19-888df6cd970b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:03:07.150219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:07.150219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:03:07.150219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:03:07.150219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:03:07.150219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:03:07.150219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:03:07.150219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:03:07.150219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:03:07.150219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:03:07.150219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:03:07.150219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:03:07.150219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:03:07.150219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:03:07.150219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:03:07.151233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:03:07.152348 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:03:07.152348 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:03:07.152348 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:03:07.152348 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:03:07.152348 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 464/899] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:03:07.157565 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e4446-853d-4d32-b879-2d861563424d None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:07.252322 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e4446-853d-4d32-b879-2d861563424d None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:07.284475 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680317a-1a25-4ae8-9d13-964992739f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:07.285132 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680317a-1a25-4ae8-9d13-964992739f5d None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:07.285415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680317a-1a25-4ae8-9d13-964992739f5d None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:07.285692 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680317a-1a25-4ae8-9d13-964992739f5d None admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:07.286402 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680317a-1a25-4ae8-9d13-964992739f5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:07.286708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680317a-1a25-4ae8-9d13-964992739f5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:07.288100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680317a-1a25-4ae8-9d13-964992739f5d None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:07.299321 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 436/900] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:03:07.304953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda133d6-d1c8-4d0e-be19-888df6cd970b None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:07.414379 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda133d6-d1c8-4d0e-be19-888df6cd970b None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:07.446051 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6f533-2c5d-4c90-8841-feb3f9ed6f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:07.446867 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6f533-2c5d-4c90-8841-feb3f9ed6f48 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:07.447140 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6f533-2c5d-4c90-8841-feb3f9ed6f48 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:07.447411 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6f533-2c5d-4c90-8841-feb3f9ed6f48 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:07.454491 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6f533-2c5d-4c90-8841-feb3f9ed6f48 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:07.455918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6f533-2c5d-4c90-8841-feb3f9ed6f48 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-98c6f533-2c5d-4c90-8841-feb3f9ed6f48 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 29 20:03:07.469795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:03:07.470910 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:03:07.471908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:03:07.471908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:03:07.471908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 29 20:03:07.471908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 29 20:03:07.471908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 29 20:03:07.471908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 29 20:03:07.471908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 29 20:03:07.471908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 29 20:03:07.471908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 29 20:03:07.471908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:03:07.471908 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 465/901] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:03:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:03:07.477157 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680317a-1a25-4ae8-9d13-964992739f5d None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:07.571209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680317a-1a25-4ae8-9d13-964992739f5d None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:07.603027 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0be59-b9a7-444b-81fb-97000826e265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:07.603674 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0be59-b9a7-444b-81fb-97000826e265 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:07.604524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0be59-b9a7-444b-81fb-97000826e265 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:07.604797 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0be59-b9a7-444b-81fb-97000826e265 None admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:07.605631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0be59-b9a7-444b-81fb-97000826e265 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:07.605929 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0be59-b9a7-444b-81fb-97000826e265 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:07.607418 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0be59-b9a7-444b-81fb-97000826e265 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:07.624153 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 437/902] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Apr 29 20:03:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:03:07.629795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6f533-2c5d-4c90-8841-feb3f9ed6f48 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:07.738093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6f533-2c5d-4c90-8841-feb3f9ed6f48 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:07.770369 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e553c16-5f9e-4541-a008-d2d56c773246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:07.770999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e553c16-5f9e-4541-a008-d2d56c773246 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:07.771272 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e553c16-5f9e-4541-a008-d2d56c773246 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:07.771537 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e553c16-5f9e-4541-a008-d2d56c773246 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:07.834183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e553c16-5f9e-4541-a008-d2d56c773246 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:07.835579 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e553c16-5f9e-4541-a008-d2d56c773246 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:07.929950 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 466/903] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Apr 29 20:03:07 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 29 20:03:07.936228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0be59-b9a7-444b-81fb-97000826e265 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:08.031790 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0be59-b9a7-444b-81fb-97000826e265 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:08.064141 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3ac34-8917-4514-94e8-5469616d8f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:08.064923 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3ac34-8917-4514-94e8-5469616d8f68 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:08.065204 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3ac34-8917-4514-94e8-5469616d8f68 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:08.065476 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3ac34-8917-4514-94e8-5469616d8f68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:08.075674 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3ac34-8917-4514-94e8-5469616d8f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:08.077162 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3ac34-8917-4514-94e8-5469616d8f68 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:08.093820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-91b3ac34-8917-4514-94e8-5469616d8f68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:03:08.093820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:08.093820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:03:08.093820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:03:08.093820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:03:08.093820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:03:08.093820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:03:08.093820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:03:08.093820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:03:08.093820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:03:08.093820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:03:08.093820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:03:08.093820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 29 20:03:08.093820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 29 20:03:08.093820 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:03:08.094975 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:03:08.096244 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 29 20:03:08.096244 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 29 20:03:08.096244 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 29 20:03:08.096244 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:03:08.096244 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 438/904] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:03:08.100673 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e553c16-5f9e-4541-a008-d2d56c773246 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:08.195347 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e553c16-5f9e-4541-a008-d2d56c773246 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:08.226503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba04f90-07eb-4834-9114-583b2b68913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:08.227145 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04f90-07eb-4834-9114-583b2b68913e None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:08.227421 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04f90-07eb-4834-9114-583b2b68913e None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:08.227687 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04f90-07eb-4834-9114-583b2b68913e None admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:08.228416 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba04f90-07eb-4834-9114-583b2b68913e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:08.228717 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba04f90-07eb-4834-9114-583b2b68913e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:08.230576 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba04f90-07eb-4834-9114-583b2b68913e None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:08.241284 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 467/905] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Apr 29 20:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:03:08.247283 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3ac34-8917-4514-94e8-5469616d8f68 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:08.340286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3ac34-8917-4514-94e8-5469616d8f68 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:08.377589 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9fd6a-0b1a-433c-9545-870eef4c5611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:08.377589 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9fd6a-0b1a-433c-9545-870eef4c5611 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:08.377589 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9fd6a-0b1a-433c-9545-870eef4c5611 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:08.377589 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9fd6a-0b1a-433c-9545-870eef4c5611 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:08.382212 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9fd6a-0b1a-433c-9545-870eef4c5611 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:08.383635 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9fd6a-0b1a-433c-9545-870eef4c5611 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:08.396924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application [None req-87d9fd6a-0b1a-433c-9545-870eef4c5611 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:03:08.396924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:08.396924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:03:08.396924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:03:08.396924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:03:08.396924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:03:08.396924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:03:08.396924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:03:08.396924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:03:08.396924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:03:08.396924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:03:08.396924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:03:08.396924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 29 20:03:08.396924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 29 20:03:08.396924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application with Lock( Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:03:08.398007 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:03:08.399142 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 29 20:03:08.399142 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 29 20:03:08.399142 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 29 20:03:08.399142 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 29 20:03:08.399142 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 29 20:03:08.399142 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 29 20:03:08.399142 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 29 20:03:08.399142 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: ERROR keystone.server.flask.application Apr 29 20:03:08.399142 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 439/906] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Apr 29 20:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:03:08.404177 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba04f90-07eb-4834-9114-583b2b68913e None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:08.500200 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba04f90-07eb-4834-9114-583b2b68913e None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:08.533005 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbcaba-96bc-407f-9a1f-4eb0defca89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:08.533659 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbcaba-96bc-407f-9a1f-4eb0defca89d None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:08.533939 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbcaba-96bc-407f-9a1f-4eb0defca89d None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:08.534212 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbcaba-96bc-407f-9a1f-4eb0defca89d None admin] PATH_INFO: `/v3/projects` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:08.534993 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbcaba-96bc-407f-9a1f-4eb0defca89d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:08.535301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbcaba-96bc-407f-9a1f-4eb0defca89d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:08.536805 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbcaba-96bc-407f-9a1f-4eb0defca89d None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:08.549278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 468/907] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Apr 29 20:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:03:08.555373 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9fd6a-0b1a-433c-9545-870eef4c5611 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:08.651107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9fd6a-0b1a-433c-9545-870eef4c5611 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:08.683374 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75caa1d1-ff9b-4abe-94bf-98c45b8b5f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:08.684060 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caa1d1-ff9b-4abe-94bf-98c45b8b5f9c None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:08.684330 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caa1d1-ff9b-4abe-94bf-98c45b8b5f9c None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:08.684608 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75caa1d1-ff9b-4abe-94bf-98c45b8b5f9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:08.685413 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75caa1d1-ff9b-4abe-94bf-98c45b8b5f9c None admin] RBAC: Adding query filter params (role.id=5255ed3fa613448fb4c549f5bc7f20af, scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c, user.id=1d4caa8120a44bc79044e1459759ce4a) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:08.685721 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75caa1d1-ff9b-4abe-94bf-98c45b8b5f9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:08.687136 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75caa1d1-ff9b-4abe-94bf-98c45b8b5f9c None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:08.692895 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 440/908] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Apr 29 20:03:08 2022] GET /identity/v3/role_assignments?user.id=1d4caa8120a44bc79044e1459759ce4a&scope.project.id=d13e73e4e3bf4143b30c02ccf7e1a13c&role.id=5255ed3fa613448fb4c549f5bc7f20af => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:03:11.046857 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cde693-8765-4fb1-bd77-da0c0f5a5e68 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:11.047453 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cde693-8765-4fb1-bd77-da0c0f5a5e68 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:11.047453 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cde693-8765-4fb1-bd77-da0c0f5a5e68 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:11.048796 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 469/909] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:03:11.054117 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3bee5-a01d-422b-951d-6bacf678ce52 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:11.058080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3bee5-a01d-422b-951d-6bacf678ce52 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:11.058080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3bee5-a01d-422b-951d-6bacf678ce52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:11.071351 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-51c3bee5-a01d-422b-951d-6bacf678ce52 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:03:11.072566 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-51c3bee5-a01d-422b-951d-6bacf678ce52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:03:11.136071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 441/910] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:03:11 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:03:11.159819 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cde693-8765-4fb1-bd77-da0c0f5a5e68 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:11.256060 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cde693-8765-4fb1-bd77-da0c0f5a5e68 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:11.288123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172b370-367b-4570-8f31-2d7239400d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:11.288934 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172b370-367b-4570-8f31-2d7239400d4b None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:11.289207 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172b370-367b-4570-8f31-2d7239400d4b None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:11.289473 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172b370-367b-4570-8f31-2d7239400d4b None admin] PATH_INFO: `/v3/services/placement` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:11.290113 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172b370-367b-4570-8f31-2d7239400d4b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:11.292017 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172b370-367b-4570-8f31-2d7239400d4b None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-8172b370-367b-4570-8f31-2d7239400d4b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:03:11.303475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:03:11.304738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:03:11.305811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:03:11.305811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:03:11.305811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:03:11.305811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:03:11.305811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:03:11.305811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:03:11.305811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:03:11.305811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:03:11.305811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:03:11.305811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:03:11.305811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:03:11.305811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:03:11.305811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 20:03:11.305811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:03:11.305811 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 470/911] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Apr 29 20:03:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:03:11.311583 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3bee5-a01d-422b-951d-6bacf678ce52 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:11.406838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3bee5-a01d-422b-951d-6bacf678ce52 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:11.439017 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04303d2-5b02-44cc-9891-6a76c79a7123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:11.439671 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04303d2-5b02-44cc-9891-6a76c79a7123 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:11.439955 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04303d2-5b02-44cc-9891-6a76c79a7123 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:11.440263 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04303d2-5b02-44cc-9891-6a76c79a7123 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:11.440953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04303d2-5b02-44cc-9891-6a76c79a7123 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:11.441254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04303d2-5b02-44cc-9891-6a76c79a7123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:11.442668 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04303d2-5b02-44cc-9891-6a76c79a7123 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:11.447489 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 442/912] 10.222.0.58 () {56 vars in 1116 bytes} [Fri Apr 29 20:03:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:03:11.453905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172b370-367b-4570-8f31-2d7239400d4b None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:11.546092 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172b370-367b-4570-8f31-2d7239400d4b None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:11.578087 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb87ff-0341-476f-808b-4bb541a8ca34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:11.578689 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb87ff-0341-476f-808b-4bb541a8ca34 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:11.578973 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb87ff-0341-476f-808b-4bb541a8ca34 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:11.579250 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb87ff-0341-476f-808b-4bb541a8ca34 None admin] PATH_INFO: `/v3/services` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:11.579951 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb87ff-0341-476f-808b-4bb541a8ca34 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:11.581206 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb87ff-0341-476f-808b-4bb541a8ca34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:11.581638 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb87ff-0341-476f-808b-4bb541a8ca34 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:11.585952 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 471/913] 10.222.0.58 () {56 vars in 1116 bytes} [Fri Apr 29 20:03:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:03:13.877914 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a4943-fe81-4bec-b41d-25ce0426b128 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:13.878480 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a4943-fe81-4bec-b41d-25ce0426b128 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:13.878480 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a4943-fe81-4bec-b41d-25ce0426b128 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:13.879795 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 443/914] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:03:13.885032 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7206cda-9a9c-4d55-8d05-d98f0e260495 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:13.886023 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7206cda-9a9c-4d55-8d05-d98f0e260495 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:13.886127 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7206cda-9a9c-4d55-8d05-d98f0e260495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:13.902831 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-f7206cda-9a9c-4d55-8d05-d98f0e260495 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:03:13.904017 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-f7206cda-9a9c-4d55-8d05-d98f0e260495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:03:13.967170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 472/915] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:03:13 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:03:13.991376 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a4943-fe81-4bec-b41d-25ce0426b128 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:14.086814 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a4943-fe81-4bec-b41d-25ce0426b128 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:14.119596 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79c334-6d36-4ff5-a4f9-08b70dac4ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:14.120273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c334-6d36-4ff5-a4f9-08b70dac4ab7 None admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:14.120597 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c334-6d36-4ff5-a4f9-08b70dac4ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:14.120859 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c334-6d36-4ff5-a4f9-08b70dac4ab7 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:14.121562 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79c334-6d36-4ff5-a4f9-08b70dac4ab7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:14.122909 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79c334-6d36-4ff5-a4f9-08b70dac4ab7 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:14.169731 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 444/916] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Apr 29 20:03:13 2022] POST /identity/v3/services => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:03:16.455763 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc975225-61f1-457a-9720-90dc5641fcd5 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:16.456312 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc975225-61f1-457a-9720-90dc5641fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:16.456312 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc975225-61f1-457a-9720-90dc5641fcd5 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:16.457661 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 473/917] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:03:16.462826 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337613e7-97f2-40bb-aea5-4d3916cf24d3 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:16.463292 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337613e7-97f2-40bb-aea5-4d3916cf24d3 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:16.463392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337613e7-97f2-40bb-aea5-4d3916cf24d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:16.480786 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-337613e7-97f2-40bb-aea5-4d3916cf24d3 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:03:16.481971 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-337613e7-97f2-40bb-aea5-4d3916cf24d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:03:16.551388 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 445/918] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:03:16 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:03:16.575597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc975225-61f1-457a-9720-90dc5641fcd5 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:16.672933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc975225-61f1-457a-9720-90dc5641fcd5 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:16.706261 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d0867-e3b2-4868-baa8-27ad951c222c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:16.707048 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d0867-e3b2-4868-baa8-27ad951c222c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:16.707328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d0867-e3b2-4868-baa8-27ad951c222c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:16.707599 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d0867-e3b2-4868-baa8-27ad951c222c None admin] PATH_INFO: `/v3/services/placement` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:16.708267 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d0867-e3b2-4868-baa8-27ad951c222c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:16.709633 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d0867-e3b2-4868-baa8-27ad951c222c None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-443d0867-e3b2-4868-baa8-27ad951c222c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:03:16.721679 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:03:16.722652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:03:16.723547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:03:16.723547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:03:16.723547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:03:16.723547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:03:16.723547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:03:16.723547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:03:16.723547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:03:16.723547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:03:16.723547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:03:16.723547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:03:16.723547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:03:16.723547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:03:16.723547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 20:03:16.723547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:03:16.723547 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 474/919] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Apr 29 20:03:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:03:16.730005 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337613e7-97f2-40bb-aea5-4d3916cf24d3 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:16.827393 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337613e7-97f2-40bb-aea5-4d3916cf24d3 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:16.861055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8034c38-e122-4c2d-9893-3cdc9abcd4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:16.862982 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8034c38-e122-4c2d-9893-3cdc9abcd4f5 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:16.862982 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8034c38-e122-4c2d-9893-3cdc9abcd4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:16.862982 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8034c38-e122-4c2d-9893-3cdc9abcd4f5 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:16.862982 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8034c38-e122-4c2d-9893-3cdc9abcd4f5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:16.863386 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8034c38-e122-4c2d-9893-3cdc9abcd4f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:16.864590 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8034c38-e122-4c2d-9893-3cdc9abcd4f5 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:16.869547 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 446/920] 10.222.0.58 () {56 vars in 1116 bytes} [Fri Apr 29 20:03:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:03:16.875465 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d0867-e3b2-4868-baa8-27ad951c222c None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:16.970931 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d0867-e3b2-4868-baa8-27ad951c222c None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:17.003009 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59613bce-b09d-4d43-b915-0a11c1d1eb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:17.003647 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59613bce-b09d-4d43-b915-0a11c1d1eb3c None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:17.003920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59613bce-b09d-4d43-b915-0a11c1d1eb3c None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:17.004215 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59613bce-b09d-4d43-b915-0a11c1d1eb3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:17.004983 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59613bce-b09d-4d43-b915-0a11c1d1eb3c None admin] RBAC: Adding query filter params (interface=public, service_id=abfb17f6f2bb4ae2a35bff5df9120d48, region_id=RegionOne) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:17.005282 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59613bce-b09d-4d43-b915-0a11c1d1eb3c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:17.006666 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59613bce-b09d-4d43-b915-0a11c1d1eb3c None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:17.011446 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 475/921] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Apr 29 20:03:16 2022] GET /identity/v3/endpoints?service_id=abfb17f6f2bb4ae2a35bff5df9120d48&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:03:17.017171 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8034c38-e122-4c2d-9893-3cdc9abcd4f5 None admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:17.115155 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8034c38-e122-4c2d-9893-3cdc9abcd4f5 None admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:17.147489 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfafcda-08a0-4677-aa57-3b3a5c64276a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:17.148173 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfafcda-08a0-4677-aa57-3b3a5c64276a None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:17.148459 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfafcda-08a0-4677-aa57-3b3a5c64276a None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:17.148734 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfafcda-08a0-4677-aa57-3b3a5c64276a None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:17.149401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfafcda-08a0-4677-aa57-3b3a5c64276a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:17.151671 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfafcda-08a0-4677-aa57-3b3a5c64276a None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:17.157988 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 447/922] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Apr 29 20:03:17 2022] GET /identity/v3/services => generated 1962 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 20:03:19.458350 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c8af4-75ad-4a68-ba94-e076ec8ec012 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:19.458877 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c8af4-75ad-4a68-ba94-e076ec8ec012 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:19.458877 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c8af4-75ad-4a68-ba94-e076ec8ec012 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:19.460308 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 476/923] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:03:19.465406 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211363-1735-444a-8292-8cc8dfeabb3d None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:19.465873 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211363-1735-444a-8292-8cc8dfeabb3d None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:19.465977 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211363-1735-444a-8292-8cc8dfeabb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:19.482848 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-35211363-1735-444a-8292-8cc8dfeabb3d None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:03:19.484091 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-35211363-1735-444a-8292-8cc8dfeabb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:03:19.547215 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 448/924] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:03:19 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 29 20:03:19.571636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c8af4-75ad-4a68-ba94-e076ec8ec012 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:19.668940 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c8af4-75ad-4a68-ba94-e076ec8ec012 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:19.700659 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e0881-08a3-43fd-b85c-6c246c716d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:19.701443 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e0881-08a3-43fd-b85c-6c246c716d68 None admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:19.701729 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e0881-08a3-43fd-b85c-6c246c716d68 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:19.701997 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e0881-08a3-43fd-b85c-6c246c716d68 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:19.702637 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e0881-08a3-43fd-b85c-6c246c716d68 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:19.704023 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e0881-08a3-43fd-b85c-6c246c716d68 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application [None req-a83e0881-08a3-43fd-b85c-6c246c716d68 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 29 20:03:19.716258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 29 20:03:19.717419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.get_or_create( Apr 29 20:03:19.718397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 29 20:03:19.718397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application with Lock( Apr 29 20:03:19.718397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 29 20:03:19.718397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self._enter() Apr 29 20:03:19.718397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 29 20:03:19.718397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 29 20:03:19.718397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 29 20:03:19.718397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application return self.creator() Apr 29 20:03:19.718397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 29 20:03:19.718397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application created_value = creator( Apr 29 20:03:19.718397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 29 20:03:19.718397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 29 20:03:19.718397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 29 20:03:19.718397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: ERROR keystone.server.flask.application Apr 29 20:03:19.718397 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 477/925] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Apr 29 20:03:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 29 20:03:19.723760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35211363-1735-444a-8292-8cc8dfeabb3d None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:19.820182 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35211363-1735-444a-8292-8cc8dfeabb3d None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:19.852807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123601a2-77cf-49da-b40a-69cac043df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:19.853460 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123601a2-77cf-49da-b40a-69cac043df51 None admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:19.854384 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123601a2-77cf-49da-b40a-69cac043df51 None admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:19.854663 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123601a2-77cf-49da-b40a-69cac043df51 None admin] PATH_INFO: `/v3/services` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:19.855356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123601a2-77cf-49da-b40a-69cac043df51 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:03:19.855657 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123601a2-77cf-49da-b40a-69cac043df51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:19.857056 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123601a2-77cf-49da-b40a-69cac043df51 None admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:19.861924 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 449/926] 10.222.0.58 () {56 vars in 1116 bytes} [Fri Apr 29 20:03:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:03:19.867647 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e0881-08a3-43fd-b85c-6c246c716d68 None admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:03:19.961478 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e0881-08a3-43fd-b85c-6c246c716d68 None admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:03:19.993971 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0f2f2-98d9-410d-b52f-b21525b1a7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:03:19.994639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0f2f2-98d9-410d-b52f-b21525b1a7b8 None admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:03:19.994912 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0f2f2-98d9-410d-b52f-b21525b1a7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:03:19.995180 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0f2f2-98d9-410d-b52f-b21525b1a7b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:03:19.996007 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0f2f2-98d9-410d-b52f-b21525b1a7b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:03:19.997382 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0f2f2-98d9-410d-b52f-b21525b1a7b8 None admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:03:20.081851 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 478/927] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Apr 29 20:03:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:09:42.573684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6482d0-366d-4955-b647-a8d20852574c None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:42.574264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6482d0-366d-4955-b647-a8d20852574c None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:42.575831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6482d0-366d-4955-b647-a8d20852574c None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:42.577545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 450/928] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:09:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:09:42.583300 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeec8b-d97a-4716-9c0d-aa3428ba8e6d None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:42.583300 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeec8b-d97a-4716-9c0d-aa3428ba8e6d None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:42.583300 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeec8b-d97a-4716-9c0d-aa3428ba8e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:42.667511 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-2ebeec8b-d97a-4716-9c0d-aa3428ba8e6d None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:09:42.668595 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-2ebeec8b-d97a-4716-9c0d-aa3428ba8e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:09:42.789683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 479/929] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:09:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:09:42.846810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139187c-9cb3-49ca-88bb-1a9d6bdc7f7e None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:42.846810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139187c-9cb3-49ca-88bb-1a9d6bdc7f7e None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:42.846810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139187c-9cb3-49ca-88bb-1a9d6bdc7f7e None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:42.846810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 451/930] 10.222.0.58 () {54 vars in 964 bytes} [Fri Apr 29 20:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:09:42.849718 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2872bc-b432-4373-8edd-af56794df9f2 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:42.850170 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2872bc-b432-4373-8edd-af56794df9f2 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:42.850447 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2872bc-b432-4373-8edd-af56794df9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:42.916546 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-1b2872bc-b432-4373-8edd-af56794df9f2 None None] MFA Rules not processed for user `a40ef0418f4a4bb7908e685d9f5d2966`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:09:42.916546 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-1b2872bc-b432-4373-8edd-af56794df9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:09:43.008269 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 480/931] 10.222.0.58 () {58 vars in 1061 bytes} [Fri Apr 29 20:09:42 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:09:43.018726 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139187c-9cb3-49ca-88bb-1a9d6bdc7f7e None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:09:43.030156 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139187c-9cb3-49ca-88bb-1a9d6bdc7f7e None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:09:43.033713 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034d909-4bb1-4a4f-a3a2-f48c742e7a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:09:43.034345 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034d909-4bb1-4a4f-a3a2-f48c742e7a5e service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:43.034660 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034d909-4bb1-4a4f-a3a2-f48c742e7a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:43.034947 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034d909-4bb1-4a4f-a3a2-f48c742e7a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:43.044405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034d909-4bb1-4a4f-a3a2-f48c742e7a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:09:43.045863 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034d909-4bb1-4a4f-a3a2-f48c742e7a5e service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:09:43.056302 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 452/932] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:09:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 20:09:45.649702 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222fcd-dbb5-4a19-a400-d83d535bac0e None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:45.650211 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222fcd-dbb5-4a19-a400-d83d535bac0e None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:45.650211 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222fcd-dbb5-4a19-a400-d83d535bac0e None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:45.651507 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 481/933] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:09:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:09:45.656656 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d2edf-7dc0-4322-89b1-9dc8dec50a26 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:45.657079 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d2edf-7dc0-4322-89b1-9dc8dec50a26 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:45.657251 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d2edf-7dc0-4322-89b1-9dc8dec50a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:45.675199 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-743d2edf-7dc0-4322-89b1-9dc8dec50a26 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:09:45.676412 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-743d2edf-7dc0-4322-89b1-9dc8dec50a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:09:45.684810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 453/934] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:09:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:09:45.723406 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22222fcd-dbb5-4a19-a400-d83d535bac0e None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:09:45.734279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22222fcd-dbb5-4a19-a400-d83d535bac0e None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:09:45.737689 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb10fa-a2b2-44f4-887b-01241ff2f52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:09:45.738316 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb10fa-a2b2-44f4-887b-01241ff2f52a service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:45.738593 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb10fa-a2b2-44f4-887b-01241ff2f52a service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:45.738865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb10fa-a2b2-44f4-887b-01241ff2f52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:45.748047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb10fa-a2b2-44f4-887b-01241ff2f52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:09:45.749454 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb10fa-a2b2-44f4-887b-01241ff2f52a service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:09:45.758970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 482/935] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:09:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:09:48.661655 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf1817-d6f4-4328-8221-a128749beb31 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:48.662157 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf1817-d6f4-4328-8221-a128749beb31 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:48.662157 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf1817-d6f4-4328-8221-a128749beb31 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:48.663495 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 454/936] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:09:48.668684 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccd976-0843-45c3-83af-a38848466646 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:48.669091 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccd976-0843-45c3-83af-a38848466646 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:48.669237 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccd976-0843-45c3-83af-a38848466646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:48.724947 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-40ccd976-0843-45c3-83af-a38848466646 None None] MFA Rules not processed for user `2e9ab844a05c4fdd9290df822186517e`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:09:48.726132 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-40ccd976-0843-45c3-83af-a38848466646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:09:48.808038 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 483/937] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:09:48 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:09:48.848801 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf1817-d6f4-4328-8221-a128749beb31 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:09:48.859129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf1817-d6f4-4328-8221-a128749beb31 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:09:48.862711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7e026-f784-401c-95f9-c1623a0c677d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:09:48.863396 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7e026-f784-401c-95f9-c1623a0c677d service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:48.863680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7e026-f784-401c-95f9-c1623a0c677d service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:48.863951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7e026-f784-401c-95f9-c1623a0c677d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:48.875922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7e026-f784-401c-95f9-c1623a0c677d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:09:48.877404 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7e026-f784-401c-95f9-c1623a0c677d service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:09:48.896818 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 455/938] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:09:48 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:09:52.158693 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b4ee3-7e07-48d1-a4bc-c254ab68c5bd None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:52.159281 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b4ee3-7e07-48d1-a4bc-c254ab68c5bd None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:52.159281 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b4ee3-7e07-48d1-a4bc-c254ab68c5bd None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:52.160619 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 484/939] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:09:52.165707 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd4ba3-aa86-4e4d-8786-1ffdf03dccce None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:52.166134 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd4ba3-aa86-4e4d-8786-1ffdf03dccce None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:52.166254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd4ba3-aa86-4e4d-8786-1ffdf03dccce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:52.184489 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-eedd4ba3-aa86-4e4d-8786-1ffdf03dccce None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:09:52.185675 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-eedd4ba3-aa86-4e4d-8786-1ffdf03dccce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:09:52.254094 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 456/940] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:09:52 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:09:52.310177 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b129bf-2b2a-48c5-985e-4e8d2b36cea6 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:52.310455 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b129bf-2b2a-48c5-985e-4e8d2b36cea6 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:52.310728 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b129bf-2b2a-48c5-985e-4e8d2b36cea6 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:52.312435 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 485/941] 10.222.0.58 () {54 vars in 964 bytes} [Fri Apr 29 20:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:09:52.318565 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab80678-0368-463a-850f-5b3a06436713 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:52.318856 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab80678-0368-463a-850f-5b3a06436713 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:52.319128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab80678-0368-463a-850f-5b3a06436713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:52.336733 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-fab80678-0368-463a-850f-5b3a06436713 None None] MFA Rules not processed for user `a40ef0418f4a4bb7908e685d9f5d2966`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:09:52.337908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-fab80678-0368-463a-850f-5b3a06436713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:09:52.344374 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 457/942] 10.222.0.58 () {58 vars in 1061 bytes} [Fri Apr 29 20:09:52 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:09:52.353886 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b129bf-2b2a-48c5-985e-4e8d2b36cea6 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:09:52.364653 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b129bf-2b2a-48c5-985e-4e8d2b36cea6 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:09:52.368813 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283ac0a-2a9a-4695-babf-e65641cb9d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:09:52.369442 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283ac0a-2a9a-4695-babf-e65641cb9d01 service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:52.369722 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283ac0a-2a9a-4695-babf-e65641cb9d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:52.369994 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283ac0a-2a9a-4695-babf-e65641cb9d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:52.378553 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283ac0a-2a9a-4695-babf-e65641cb9d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:09:52.379995 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283ac0a-2a9a-4695-babf-e65641cb9d01 service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:09:52.389149 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 486/943] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:09:52 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:09:56.158718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466427-8d59-4b04-9aed-cb611f4f3bbd None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:56.159273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466427-8d59-4b04-9aed-cb611f4f3bbd None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:56.159273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466427-8d59-4b04-9aed-cb611f4f3bbd None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:56.160714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 458/944] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:09:56.165751 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d0b5b-d899-4de0-bfc0-1009cf5aa47b None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:56.166135 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d0b5b-d899-4de0-bfc0-1009cf5aa47b None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:56.166419 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d0b5b-d899-4de0-bfc0-1009cf5aa47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:56.183645 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-f65d0b5b-d899-4de0-bfc0-1009cf5aa47b None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:09:56.184868 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-f65d0b5b-d899-4de0-bfc0-1009cf5aa47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:09:56.192602 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 487/945] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:09:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:09:56.229383 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5466427-8d59-4b04-9aed-cb611f4f3bbd None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:09:56.239762 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5466427-8d59-4b04-9aed-cb611f4f3bbd None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:09:56.243219 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679af17-b2ca-4b28-b019-5545fad5ccb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:09:56.243909 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679af17-b2ca-4b28-b019-5545fad5ccb2 service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:56.244279 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679af17-b2ca-4b28-b019-5545fad5ccb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:56.244615 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679af17-b2ca-4b28-b019-5545fad5ccb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:56.253214 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679af17-b2ca-4b28-b019-5545fad5ccb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:09:56.254683 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679af17-b2ca-4b28-b019-5545fad5ccb2 service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:09:56.264382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 459/946] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:09:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:09:58.603297 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185ba40-1552-4ab4-86f9-c61a33816d48 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:58.603841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185ba40-1552-4ab4-86f9-c61a33816d48 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:58.603841 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185ba40-1552-4ab4-86f9-c61a33816d48 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:58.605318 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 488/947] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:09:58.610881 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad4539-f83b-4b49-a6b9-3828df89b18c None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:58.611409 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad4539-f83b-4b49-a6b9-3828df89b18c None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:58.611409 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad4539-f83b-4b49-a6b9-3828df89b18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:58.629337 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-0bad4539-f83b-4b49-a6b9-3828df89b18c None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:09:58.630514 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-0bad4539-f83b-4b49-a6b9-3828df89b18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:09:58.638869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 460/948] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:09:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:09:58.674820 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185ba40-1552-4ab4-86f9-c61a33816d48 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:09:58.685678 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185ba40-1552-4ab4-86f9-c61a33816d48 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:09:58.690895 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02309828-4fbe-4eb4-8d48-cd3b2a9de2ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:09:58.690895 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02309828-4fbe-4eb4-8d48-cd3b2a9de2ee service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:09:58.690895 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02309828-4fbe-4eb4-8d48-cd3b2a9de2ee service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:09:58.690895 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02309828-4fbe-4eb4-8d48-cd3b2a9de2ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:09:58.699577 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02309828-4fbe-4eb4-8d48-cd3b2a9de2ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:09:58.701024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02309828-4fbe-4eb4-8d48-cd3b2a9de2ee service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:09:58.710187 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 489/949] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:09:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:01.090625 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cae9c-4586-475e-9fc5-5a31c0a4fda8 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:01.091160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cae9c-4586-475e-9fc5-5a31c0a4fda8 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:01.091160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cae9c-4586-475e-9fc5-5a31c0a4fda8 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:01.092574 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 461/950] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:01.098073 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d3d54-abeb-4797-a0a5-4e872dd29856 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:01.098475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d3d54-abeb-4797-a0a5-4e872dd29856 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:01.098629 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d3d54-abeb-4797-a0a5-4e872dd29856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:01.115803 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-164d3d54-abeb-4797-a0a5-4e872dd29856 None None] MFA Rules not processed for user `2e9ab844a05c4fdd9290df822186517e`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:01.117029 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-164d3d54-abeb-4797-a0a5-4e872dd29856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:01.124722 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 490/951] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:01 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:01.163233 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cae9c-4586-475e-9fc5-5a31c0a4fda8 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:01.173495 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cae9c-4586-475e-9fc5-5a31c0a4fda8 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:01.176952 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7e95a-393d-44d2-8a80-483ac96d81e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:01.177577 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7e95a-393d-44d2-8a80-483ac96d81e8 service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:01.177852 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7e95a-393d-44d2-8a80-483ac96d81e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:01.178124 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7e95a-393d-44d2-8a80-483ac96d81e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:01.186592 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7e95a-393d-44d2-8a80-483ac96d81e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:01.188118 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7e95a-393d-44d2-8a80-483ac96d81e8 service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:01.197988 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 462/952] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:01 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:04.017070 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d152c8e-1f9a-4f3c-b899-2b5ad0fccc69 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:04.017597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d152c8e-1f9a-4f3c-b899-2b5ad0fccc69 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:04.017597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d152c8e-1f9a-4f3c-b899-2b5ad0fccc69 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:04.018877 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 491/953] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:04.024688 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb38c23-f4ba-4813-8d6e-fc00b18fb307 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:04.025112 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb38c23-f4ba-4813-8d6e-fc00b18fb307 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:04.025234 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb38c23-f4ba-4813-8d6e-fc00b18fb307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:04.042555 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-2eb38c23-f4ba-4813-8d6e-fc00b18fb307 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:04.043738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-2eb38c23-f4ba-4813-8d6e-fc00b18fb307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:04.051343 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 463/954] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:04.088132 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d152c8e-1f9a-4f3c-b899-2b5ad0fccc69 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:04.098747 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d152c8e-1f9a-4f3c-b899-2b5ad0fccc69 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:04.102275 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7563f-ad39-45ba-a14f-e7175efcf728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:04.102928 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7563f-ad39-45ba-a14f-e7175efcf728 service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:04.103206 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7563f-ad39-45ba-a14f-e7175efcf728 service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:04.103475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7563f-ad39-45ba-a14f-e7175efcf728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:04.113180 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7563f-ad39-45ba-a14f-e7175efcf728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:04.114635 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7563f-ad39-45ba-a14f-e7175efcf728 service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:04.125341 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 492/955] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:06.497206 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33332b-637e-4c1f-bd4a-a651f362dd92 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:06.497699 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33332b-637e-4c1f-bd4a-a651f362dd92 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:06.497810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33332b-637e-4c1f-bd4a-a651f362dd92 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:06.499128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 464/956] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:06.504429 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2f08-be7b-4933-8d94-0cc9ccd387db None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:06.504838 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2f08-be7b-4933-8d94-0cc9ccd387db None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:06.504966 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2f08-be7b-4933-8d94-0cc9ccd387db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:06.522154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-cbcc2f08-be7b-4933-8d94-0cc9ccd387db None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:06.523351 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-cbcc2f08-be7b-4933-8d94-0cc9ccd387db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:06.531195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 493/957] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:06.572165 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33332b-637e-4c1f-bd4a-a651f362dd92 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:06.582563 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33332b-637e-4c1f-bd4a-a651f362dd92 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:06.586520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a245dd-4760-4e38-8a22-d367081ad57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:06.587202 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a245dd-4760-4e38-8a22-d367081ad57c service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:06.587482 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a245dd-4760-4e38-8a22-d367081ad57c service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:06.587750 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a245dd-4760-4e38-8a22-d367081ad57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:06.596760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a245dd-4760-4e38-8a22-d367081ad57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:06.598170 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a245dd-4760-4e38-8a22-d367081ad57c service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:06.608133 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 465/958] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:09.540134 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76586604-03fa-4f3c-867d-bbcba76bf485 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:09.540662 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76586604-03fa-4f3c-867d-bbcba76bf485 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:09.540662 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76586604-03fa-4f3c-867d-bbcba76bf485 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:09.542012 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 494/959] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:09.547299 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17833b4-f577-4b0d-8c84-fcfd32f9814d None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:09.548644 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17833b4-f577-4b0d-8c84-fcfd32f9814d None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:09.548644 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17833b4-f577-4b0d-8c84-fcfd32f9814d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:09.565512 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-b17833b4-f577-4b0d-8c84-fcfd32f9814d None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:09.566709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-b17833b4-f577-4b0d-8c84-fcfd32f9814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:09.574488 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 466/960] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:09 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:09.611599 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76586604-03fa-4f3c-867d-bbcba76bf485 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:09.622144 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76586604-03fa-4f3c-867d-bbcba76bf485 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:09.625564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf05f08-649f-43fe-8e5a-8271c4b3ed79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:09.626183 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf05f08-649f-43fe-8e5a-8271c4b3ed79 service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:09.626455 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf05f08-649f-43fe-8e5a-8271c4b3ed79 service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:09.626719 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf05f08-649f-43fe-8e5a-8271c4b3ed79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:09.635367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf05f08-649f-43fe-8e5a-8271c4b3ed79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:09.636798 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf05f08-649f-43fe-8e5a-8271c4b3ed79 service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:09.645779 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 495/961] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:09 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:14.098320 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c8198-e827-489b-8ae2-522438aa6162 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:14.098842 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c8198-e827-489b-8ae2-522438aa6162 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:14.098842 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c8198-e827-489b-8ae2-522438aa6162 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:14.100203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 467/962] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:14.105542 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c78aa6-a8fb-4d18-8c8f-dca1a611a523 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:14.105949 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c78aa6-a8fb-4d18-8c8f-dca1a611a523 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:14.106093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c78aa6-a8fb-4d18-8c8f-dca1a611a523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:14.124320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-61c78aa6-a8fb-4d18-8c8f-dca1a611a523 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:14.125515 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-61c78aa6-a8fb-4d18-8c8f-dca1a611a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:14.134135 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 496/963] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:14.175933 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c8198-e827-489b-8ae2-522438aa6162 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:14.186853 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c8198-e827-489b-8ae2-522438aa6162 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:14.190186 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedfab3-4ca8-459a-89eb-695d95889a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:14.190830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedfab3-4ca8-459a-89eb-695d95889a91 service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:14.191111 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedfab3-4ca8-459a-89eb-695d95889a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:14.191377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedfab3-4ca8-459a-89eb-695d95889a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:14.200554 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedfab3-4ca8-459a-89eb-695d95889a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:14.201964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedfab3-4ca8-459a-89eb-695d95889a91 service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:14.210965 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 468/964] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:17.417603 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2dba5-2d37-4028-8328-6272f06a31ce None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:17.418140 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2dba5-2d37-4028-8328-6272f06a31ce None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:17.418140 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2dba5-2d37-4028-8328-6272f06a31ce None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:17.419435 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 497/965] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:17.424696 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5a625-7956-4bcc-b562-035fd06b40fb None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:17.425129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5a625-7956-4bcc-b562-035fd06b40fb None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:17.425254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5a625-7956-4bcc-b562-035fd06b40fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:17.443013 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-56a5a625-7956-4bcc-b562-035fd06b40fb None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:17.444301 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-56a5a625-7956-4bcc-b562-035fd06b40fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:17.451913 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 469/966] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:17 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:17.489467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2dba5-2d37-4028-8328-6272f06a31ce None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:17.500330 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2dba5-2d37-4028-8328-6272f06a31ce None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:17.503722 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a39c98-8734-42bd-8438-9fe163937574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:17.504377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a39c98-8734-42bd-8438-9fe163937574 service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:17.504656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a39c98-8734-42bd-8438-9fe163937574 service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:17.504929 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a39c98-8734-42bd-8438-9fe163937574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:17.513416 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a39c98-8734-42bd-8438-9fe163937574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:17.514822 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a39c98-8734-42bd-8438-9fe163937574 service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:17.524265 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 498/967] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:17 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:22.501475 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373490b-83b4-45d0-aa2b-1415e8f05926 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:22.502030 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373490b-83b4-45d0-aa2b-1415e8f05926 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:22.502030 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373490b-83b4-45d0-aa2b-1415e8f05926 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:22.503405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 470/968] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:22.508701 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96575053-7c54-4dfa-9a1d-ec24a6cf62ea None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:22.509098 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96575053-7c54-4dfa-9a1d-ec24a6cf62ea None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:22.509253 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96575053-7c54-4dfa-9a1d-ec24a6cf62ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:22.526698 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-96575053-7c54-4dfa-9a1d-ec24a6cf62ea None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:22.527866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-96575053-7c54-4dfa-9a1d-ec24a6cf62ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:22.535448 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 499/969] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:22.574667 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373490b-83b4-45d0-aa2b-1415e8f05926 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:22.584974 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373490b-83b4-45d0-aa2b-1415e8f05926 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:22.594970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714c8af-0d88-48ce-b1e3-78dfe928581e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:22.594970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714c8af-0d88-48ce-b1e3-78dfe928581e service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:22.594970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714c8af-0d88-48ce-b1e3-78dfe928581e service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:22.594970 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714c8af-0d88-48ce-b1e3-78dfe928581e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:22.598932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714c8af-0d88-48ce-b1e3-78dfe928581e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:22.600511 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714c8af-0d88-48ce-b1e3-78dfe928581e service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:22.611098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 471/970] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:28.008954 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad7955-44e1-4151-b004-1c7fd954c0d6 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:28.009777 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad7955-44e1-4151-b004-1c7fd954c0d6 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:28.010255 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad7955-44e1-4151-b004-1c7fd954c0d6 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:28.012012 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 500/971] 10.222.0.58 () {54 vars in 921 bytes} [Fri Apr 29 20:10:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:28.017144 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d600ca-d44d-45b4-8b0d-f4871d28365b None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:28.017987 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d600ca-d44d-45b4-8b0d-f4871d28365b None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:28.018479 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d600ca-d44d-45b4-8b0d-f4871d28365b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:28.065768 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-66d600ca-d44d-45b4-8b0d-f4871d28365b None None] MFA Rules not processed for user `1d4caa8120a44bc79044e1459759ce4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:28.067281 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-66d600ca-d44d-45b4-8b0d-f4871d28365b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:28.145369 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 472/972] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Apr 29 20:10:28 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:32.622357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff590ec-e807-429a-bf9b-be41380bcfd1 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:32.622925 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff590ec-e807-429a-bf9b-be41380bcfd1 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:32.623196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff590ec-e807-429a-bf9b-be41380bcfd1 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:32.624894 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 501/973] 10.222.0.58 () {54 vars in 921 bytes} [Fri Apr 29 20:10:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:32.630804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ded64d-8dea-47f5-80a1-41aac9885e9e None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:32.631366 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ded64d-8dea-47f5-80a1-41aac9885e9e None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:32.631366 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ded64d-8dea-47f5-80a1-41aac9885e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:32.651991 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-b1ded64d-8dea-47f5-80a1-41aac9885e9e None None] MFA Rules not processed for user `1d4caa8120a44bc79044e1459759ce4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:32.653349 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-b1ded64d-8dea-47f5-80a1-41aac9885e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:32.662950 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 473/974] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Apr 29 20:10:32 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:34.220597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4c259-221c-4c79-b628-e9cb7834a308 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:34.221152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4c259-221c-4c79-b628-e9cb7834a308 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:34.221152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4c259-221c-4c79-b628-e9cb7834a308 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:34.222490 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 502/975] 10.222.0.58 () {54 vars in 921 bytes} [Fri Apr 29 20:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:34.228151 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe6f54-d68c-4a03-83ad-61eee21bfeb0 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:34.228580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe6f54-d68c-4a03-83ad-61eee21bfeb0 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:34.228696 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe6f54-d68c-4a03-83ad-61eee21bfeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:34.248224 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-dfbe6f54-d68c-4a03-83ad-61eee21bfeb0 None None] MFA Rules not processed for user `1d4caa8120a44bc79044e1459759ce4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:34.249421 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-dfbe6f54-d68c-4a03-83ad-61eee21bfeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:34.262408 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 474/976] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Apr 29 20:10:34 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:10:38.198887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee00508-3e48-4c9e-9e5a-fbb8c2ee8397 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:38.199512 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee00508-3e48-4c9e-9e5a-fbb8c2ee8397 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:38.199674 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee00508-3e48-4c9e-9e5a-fbb8c2ee8397 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:38.201188 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 503/977] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:10:38.206459 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18ecaf-1061-4b6b-8e30-a741bf44356b None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:38.207103 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18ecaf-1061-4b6b-8e30-a741bf44356b None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:38.207484 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18ecaf-1061-4b6b-8e30-a741bf44356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:38.226322 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-dd18ecaf-1061-4b6b-8e30-a741bf44356b None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:38.227736 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-dd18ecaf-1061-4b6b-8e30-a741bf44356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:38.243746 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 475/978] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:38.284632 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1cbbc-3a72-419e-b879-2e7bc368eb70 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:38.285057 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1cbbc-3a72-419e-b879-2e7bc368eb70 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:38.285472 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1cbbc-3a72-419e-b879-2e7bc368eb70 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:38.286986 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 504/979] 10.222.0.58 () {54 vars in 960 bytes} [Fri Apr 29 20:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:38.292427 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233959e2-5ec0-49d7-9a83-84095545d0aa None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:38.292818 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233959e2-5ec0-49d7-9a83-84095545d0aa None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:38.293196 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233959e2-5ec0-49d7-9a83-84095545d0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:38.346040 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-233959e2-5ec0-49d7-9a83-84095545d0aa None None] MFA Rules not processed for user `ca4e798ccd784e348136af337bf780f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:38.347482 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-233959e2-5ec0-49d7-9a83-84095545d0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:38.419060 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 476/980] 10.222.0.58 () {58 vars in 1057 bytes} [Fri Apr 29 20:10:38 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:10:38.426757 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1cbbc-3a72-419e-b879-2e7bc368eb70 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:38.441098 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1cbbc-3a72-419e-b879-2e7bc368eb70 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:38.446680 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4ebfa-27a4-4d18-8740-377e7bd0e8fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:38.447310 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ebfa-27a4-4d18-8740-377e7bd0e8fe service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:38.447592 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ebfa-27a4-4d18-8740-377e7bd0e8fe service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:38.447864 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ebfa-27a4-4d18-8740-377e7bd0e8fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:38.456241 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4ebfa-27a4-4d18-8740-377e7bd0e8fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:38.457760 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4ebfa-27a4-4d18-8740-377e7bd0e8fe service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:38.468424 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 505/981] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:41.016986 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3818a9f-188d-425d-9586-fe013b8999a7 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:41.017560 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3818a9f-188d-425d-9586-fe013b8999a7 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:41.017560 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3818a9f-188d-425d-9586-fe013b8999a7 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:41.019259 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 477/982] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:41.024503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2f186-fb7c-4f03-9c51-3b2d78e36cc4 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:41.025391 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2f186-fb7c-4f03-9c51-3b2d78e36cc4 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:41.025953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2f186-fb7c-4f03-9c51-3b2d78e36cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:41.044664 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-b9e2f186-fb7c-4f03-9c51-3b2d78e36cc4 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:41.045970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-b9e2f186-fb7c-4f03-9c51-3b2d78e36cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:41.054730 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 506/983] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:41.101470 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3818a9f-188d-425d-9586-fe013b8999a7 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:41.114734 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3818a9f-188d-425d-9586-fe013b8999a7 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:41.119555 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d96f6d-5c13-4028-8402-a1e48cce925b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:41.120219 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d96f6d-5c13-4028-8402-a1e48cce925b service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:41.120505 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d96f6d-5c13-4028-8402-a1e48cce925b service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:41.120780 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d96f6d-5c13-4028-8402-a1e48cce925b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:41.129029 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d96f6d-5c13-4028-8402-a1e48cce925b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:41.131243 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d96f6d-5c13-4028-8402-a1e48cce925b service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:41.140852 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 478/984] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:43.889142 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2058e-0976-43d0-a7d4-85703be03c92 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:43.889705 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2058e-0976-43d0-a7d4-85703be03c92 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:43.889803 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2058e-0976-43d0-a7d4-85703be03c92 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:43.891312 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 507/985] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:43.896815 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3ff9e-bf5c-4291-be9c-446cdb868c82 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:43.897230 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3ff9e-bf5c-4291-be9c-446cdb868c82 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:43.897377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3ff9e-bf5c-4291-be9c-446cdb868c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:43.915452 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-47e3ff9e-bf5c-4291-be9c-446cdb868c82 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:43.917264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-47e3ff9e-bf5c-4291-be9c-446cdb868c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:43.924620 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 479/986] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:43.974169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783081c-9214-4345-8e23-17d6987ea861 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:43.974459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783081c-9214-4345-8e23-17d6987ea861 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:43.974771 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783081c-9214-4345-8e23-17d6987ea861 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:43.976662 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 508/987] 10.222.0.58 () {54 vars in 960 bytes} [Fri Apr 29 20:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:43.982184 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec0c81-a569-427a-a889-33ba0f8b1ed5 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:43.982549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec0c81-a569-427a-a889-33ba0f8b1ed5 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:43.982897 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec0c81-a569-427a-a889-33ba0f8b1ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:44.001380 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-5aec0c81-a569-427a-a889-33ba0f8b1ed5 None None] MFA Rules not processed for user `ca4e798ccd784e348136af337bf780f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:44.002589 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-5aec0c81-a569-427a-a889-33ba0f8b1ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:44.011062 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 480/988] 10.222.0.58 () {58 vars in 1057 bytes} [Fri Apr 29 20:10:43 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:10:44.018798 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783081c-9214-4345-8e23-17d6987ea861 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:44.032209 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783081c-9214-4345-8e23-17d6987ea861 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:44.037148 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea874b4-c010-4aa1-8d48-c0f6f2da0175 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:44.037783 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea874b4-c010-4aa1-8d48-c0f6f2da0175 service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:44.038588 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea874b4-c010-4aa1-8d48-c0f6f2da0175 service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:44.042044 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea874b4-c010-4aa1-8d48-c0f6f2da0175 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:44.051027 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea874b4-c010-4aa1-8d48-c0f6f2da0175 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:44.052643 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea874b4-c010-4aa1-8d48-c0f6f2da0175 service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:44.074867 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 509/989] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:46.663928 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac14481-e260-4d1d-9011-a74c26c0d396 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:46.664831 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac14481-e260-4d1d-9011-a74c26c0d396 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:46.665266 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac14481-e260-4d1d-9011-a74c26c0d396 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:46.672278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38a05e-4995-4009-91d3-c41dff14502c None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:46.673056 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38a05e-4995-4009-91d3-c41dff14502c None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:46.673474 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38a05e-4995-4009-91d3-c41dff14502c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:46.676043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 481/990] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:46 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:46.693433 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-dd38a05e-4995-4009-91d3-c41dff14502c None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:46.694916 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-dd38a05e-4995-4009-91d3-c41dff14502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:46.702949 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 510/991] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:10:46.752286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac14481-e260-4d1d-9011-a74c26c0d396 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:46.773178 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac14481-e260-4d1d-9011-a74c26c0d396 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:46.781239 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a860b-47a5-4999-aff5-029c050db6b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:46.782228 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a860b-47a5-4999-aff5-029c050db6b4 service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:46.782694 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a860b-47a5-4999-aff5-029c050db6b4 service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:46.783117 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a860b-47a5-4999-aff5-029c050db6b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:46.795158 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a860b-47a5-4999-aff5-029c050db6b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:46.798246 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a860b-47a5-4999-aff5-029c050db6b4 service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:46.814275 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 482/992] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:48.287647 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5b544-a45c-4e4b-bb7b-790656ad521e None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:48.288643 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5b544-a45c-4e4b-bb7b-790656ad521e None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:48.288751 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5b544-a45c-4e4b-bb7b-790656ad521e None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:48.299332 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a05f94-e358-4a40-bbe1-fef72908cc63 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:48.300377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a05f94-e358-4a40-bbe1-fef72908cc63 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:48.304332 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a05f94-e358-4a40-bbe1-fef72908cc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:48.305516 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 511/993] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:48 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:48.336331 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-a7a05f94-e358-4a40-bbe1-fef72908cc63 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:48.338986 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-a7a05f94-e358-4a40-bbe1-fef72908cc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:48.367923 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 483/994] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:48.669865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d330a-c86b-4d74-b5db-70fa7befa4de None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:48.669865 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d330a-c86b-4d74-b5db-70fa7befa4de None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:48.670489 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d330a-c86b-4d74-b5db-70fa7befa4de None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:48.671492 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 512/995] 10.222.0.58 () {54 vars in 962 bytes} [Fri Apr 29 20:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:48.677683 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aac854-7507-465d-ac4c-917fb1f4fc5a None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:48.678059 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aac854-7507-465d-ac4c-917fb1f4fc5a None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:48.678462 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aac854-7507-465d-ac4c-917fb1f4fc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:48.730888 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-86aac854-7507-465d-ac4c-917fb1f4fc5a None None] MFA Rules not processed for user `6dc441c13aa14d6ab0446965f0d91aca`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:48.732716 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-86aac854-7507-465d-ac4c-917fb1f4fc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:48.791088 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 484/996] 10.222.0.58 () {58 vars in 1059 bytes} [Fri Apr 29 20:10:48 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:48.798422 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d330a-c86b-4d74-b5db-70fa7befa4de None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:48.809118 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d330a-c86b-4d74-b5db-70fa7befa4de None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:48.812677 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88565925-7f36-4bed-8682-a6b6a988111b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc441c13aa14d6ab0446965f0d91aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:48.813573 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88565925-7f36-4bed-8682-a6b6a988111b service cinder] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:48.813987 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88565925-7f36-4bed-8682-a6b6a988111b service cinder] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:48.814265 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88565925-7f36-4bed-8682-a6b6a988111b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:48.823581 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88565925-7f36-4bed-8682-a6b6a988111b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:48.825177 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88565925-7f36-4bed-8682-a6b6a988111b service cinder] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:48.835704 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 513/997] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:49.437728 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a0e19-ff71-4f96-b3c1-b5ca85bba015 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:49.438264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a0e19-ff71-4f96-b3c1-b5ca85bba015 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:49.438264 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a0e19-ff71-4f96-b3c1-b5ca85bba015 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:49.439631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 485/998] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:49.445832 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d037ea-ebd1-4bbb-b36d-ee267f617606 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:49.446274 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d037ea-ebd1-4bbb-b36d-ee267f617606 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:49.446426 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d037ea-ebd1-4bbb-b36d-ee267f617606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:49.464235 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-c3d037ea-ebd1-4bbb-b36d-ee267f617606 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:49.465593 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-c3d037ea-ebd1-4bbb-b36d-ee267f617606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:49.473783 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 514/999] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:49.521989 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a0e19-ff71-4f96-b3c1-b5ca85bba015 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:49.535871 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a0e19-ff71-4f96-b3c1-b5ca85bba015 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:49.541521 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b04dc-a885-4737-8af1-c63faa696426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:49.542202 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b04dc-a885-4737-8af1-c63faa696426 service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:49.542481 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b04dc-a885-4737-8af1-c63faa696426 service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:49.542754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b04dc-a885-4737-8af1-c63faa696426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:49.555319 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b04dc-a885-4737-8af1-c63faa696426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:49.557407 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b04dc-a885-4737-8af1-c63faa696426 service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:49.568914 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 486/1000] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:52.098149 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733b7f7-675e-46b9-8346-26ad5db09aeb None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:52.098676 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733b7f7-675e-46b9-8346-26ad5db09aeb None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:52.098676 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733b7f7-675e-46b9-8346-26ad5db09aeb None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:52.100364 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 515/1001] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:52.105656 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853b6d5-ae03-4cb3-8158-1cc370f9f20c None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:52.106089 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853b6d5-ae03-4cb3-8158-1cc370f9f20c None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:52.106237 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853b6d5-ae03-4cb3-8158-1cc370f9f20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:52.128406 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-0853b6d5-ae03-4cb3-8158-1cc370f9f20c None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:52.129838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-0853b6d5-ae03-4cb3-8158-1cc370f9f20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:52.144677 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 487/1002] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:10:52.189999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733b7f7-675e-46b9-8346-26ad5db09aeb None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:52.204241 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733b7f7-675e-46b9-8346-26ad5db09aeb None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:52.209081 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777435d9-a2c9-4cf6-9410-b3d98207c552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:52.210266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777435d9-a2c9-4cf6-9410-b3d98207c552 service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:52.210543 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777435d9-a2c9-4cf6-9410-b3d98207c552 service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:52.210814 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777435d9-a2c9-4cf6-9410-b3d98207c552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:52.218796 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777435d9-a2c9-4cf6-9410-b3d98207c552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:52.220655 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777435d9-a2c9-4cf6-9410-b3d98207c552 service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:52.229797 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 516/1003] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:54.725043 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fde37-23e6-438f-825e-7aee38249ead None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:54.726161 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fde37-23e6-438f-825e-7aee38249ead None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:54.726161 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fde37-23e6-438f-825e-7aee38249ead None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:54.727413 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 488/1004] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:10:54.732662 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48992689-f647-4e5b-8c96-ade96e3a2e9e None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:54.733075 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48992689-f647-4e5b-8c96-ade96e3a2e9e None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:54.733203 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48992689-f647-4e5b-8c96-ade96e3a2e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:54.750505 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-48992689-f647-4e5b-8c96-ade96e3a2e9e None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:54.751687 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-48992689-f647-4e5b-8c96-ade96e3a2e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:54.760195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 517/1005] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:54.803129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fde37-23e6-438f-825e-7aee38249ead None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:54.816326 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fde37-23e6-438f-825e-7aee38249ead None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:54.821293 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274229c-2e60-4fec-8f7a-dc2d87c09da6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:54.822019 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274229c-2e60-4fec-8f7a-dc2d87c09da6 service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:54.822301 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274229c-2e60-4fec-8f7a-dc2d87c09da6 service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:54.822575 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274229c-2e60-4fec-8f7a-dc2d87c09da6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:54.831177 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274229c-2e60-4fec-8f7a-dc2d87c09da6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:54.832810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274229c-2e60-4fec-8f7a-dc2d87c09da6 service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:54.843174 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 489/1006] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:57.234006 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ac509-3061-4da7-810f-ea68c5db34ce None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:57.234799 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ac509-3061-4da7-810f-ea68c5db34ce None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:57.234799 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ac509-3061-4da7-810f-ea68c5db34ce None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:57.236038 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 518/1007] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:10:57.242219 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2c6e4-9916-412b-9424-2a22b0e08539 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:57.242646 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2c6e4-9916-412b-9424-2a22b0e08539 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:57.242797 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2c6e4-9916-412b-9424-2a22b0e08539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:57.263618 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-ecc2c6e4-9916-412b-9424-2a22b0e08539 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:10:57.264876 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-ecc2c6e4-9916-412b-9424-2a22b0e08539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:10:57.274769 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 490/1008] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:10:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:10:57.323150 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ac509-3061-4da7-810f-ea68c5db34ce None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:10:57.337667 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ac509-3061-4da7-810f-ea68c5db34ce None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:10:57.345160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ae95a-69c8-4195-b6e1-0a3984223285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:10:57.345842 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ae95a-69c8-4195-b6e1-0a3984223285 service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:10:57.346119 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ae95a-69c8-4195-b6e1-0a3984223285 service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:10:57.346393 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ae95a-69c8-4195-b6e1-0a3984223285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:10:57.355850 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ae95a-69c8-4195-b6e1-0a3984223285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:10:57.357631 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ae95a-69c8-4195-b6e1-0a3984223285 service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:10:57.370693 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 519/1009] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:10:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:10:59.996589 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cf602-fa3b-4baf-8b4e-819611bc7514 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:00.031296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cf602-fa3b-4baf-8b4e-819611bc7514 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:00.031296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cf602-fa3b-4baf-8b4e-819611bc7514 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:00.031296 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 491/1010] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:11:00.032145 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d81e-e647-40f6-b33f-c549c9d288dd None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:00.032145 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d81e-e647-40f6-b33f-c549c9d288dd None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:00.032145 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d81e-e647-40f6-b33f-c549c9d288dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:00.032145 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-f791d81e-e647-40f6-b33f-c549c9d288dd None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:00.032145 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-f791d81e-e647-40f6-b33f-c549c9d288dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:00.033564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 520/1011] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:11:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:00.077841 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cf602-fa3b-4baf-8b4e-819611bc7514 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:00.091049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cf602-fa3b-4baf-8b4e-819611bc7514 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:00.096639 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01706b-6806-4572-b459-60ea53942725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:00.097273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01706b-6806-4572-b459-60ea53942725 service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:00.097554 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01706b-6806-4572-b459-60ea53942725 service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:00.097832 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01706b-6806-4572-b459-60ea53942725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:00.108211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01706b-6806-4572-b459-60ea53942725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:00.110430 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01706b-6806-4572-b459-60ea53942725 service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:00.122927 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 492/1012] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:03.438892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6fc59-3aca-4349-8dcd-0a42b80990c2 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:03.439548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6fc59-3aca-4349-8dcd-0a42b80990c2 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:03.439548 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6fc59-3aca-4349-8dcd-0a42b80990c2 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:03.440797 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 521/1013] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:03.445949 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c47d55-fc65-4301-b2c7-15bc2c122c2d None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:03.446451 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c47d55-fc65-4301-b2c7-15bc2c122c2d None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:03.446560 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c47d55-fc65-4301-b2c7-15bc2c122c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:03.464280 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-14c47d55-fc65-4301-b2c7-15bc2c122c2d None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:03.465464 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-14c47d55-fc65-4301-b2c7-15bc2c122c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:03.473439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 493/1014] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:11:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:03.518352 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6fc59-3aca-4349-8dcd-0a42b80990c2 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:03.531672 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6fc59-3aca-4349-8dcd-0a42b80990c2 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:03.536566 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12b5e9-073b-411d-8de9-f477663485c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:03.537195 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12b5e9-073b-411d-8de9-f477663485c4 service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:03.537979 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12b5e9-073b-411d-8de9-f477663485c4 service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:03.538251 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12b5e9-073b-411d-8de9-f477663485c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:03.546130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12b5e9-073b-411d-8de9-f477663485c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:03.547698 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12b5e9-073b-411d-8de9-f477663485c4 service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:03.557553 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 522/1015] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:05.082415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f4227-54dc-418f-ab91-16495971b217 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:05.083030 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f4227-54dc-418f-ab91-16495971b217 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:05.083030 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f4227-54dc-418f-ab91-16495971b217 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:05.084901 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 494/1016] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:05.090185 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc086c30-2883-4715-a969-b4e41e8a92b5 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:05.090640 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc086c30-2883-4715-a969-b4e41e8a92b5 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:05.090749 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc086c30-2883-4715-a969-b4e41e8a92b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:05.108599 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-fc086c30-2883-4715-a969-b4e41e8a92b5 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:05.109757 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-fc086c30-2883-4715-a969-b4e41e8a92b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:05.117398 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 523/1017] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:11:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:05.173472 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018686c-611c-4f53-b831-a55f8a69273b None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:05.173754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018686c-611c-4f53-b831-a55f8a69273b None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:05.174027 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018686c-611c-4f53-b831-a55f8a69273b None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:05.175378 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 495/1018] 10.222.0.58 () {54 vars in 962 bytes} [Fri Apr 29 20:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:05.180353 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762e9c6-906b-4f37-b1ae-04f261df2a54 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:05.180642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762e9c6-906b-4f37-b1ae-04f261df2a54 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:05.180920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762e9c6-906b-4f37-b1ae-04f261df2a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:05.228215 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-5762e9c6-906b-4f37-b1ae-04f261df2a54 None None] MFA Rules not processed for user `685208fceb044edb9970003b5225f3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:05.229393 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-5762e9c6-906b-4f37-b1ae-04f261df2a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:05.286414 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 524/1019] 10.222.0.58 () {58 vars in 1059 bytes} [Fri Apr 29 20:11:05 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:05.297000 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018686c-611c-4f53-b831-a55f8a69273b None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:05.308031 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018686c-611c-4f53-b831-a55f8a69273b None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:05.311797 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7331d-6e2b-459e-8105-1830367705ac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685208fceb044edb9970003b5225f3ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:05.312474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7331d-6e2b-459e-8105-1830367705ac service glance] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:05.312751 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7331d-6e2b-459e-8105-1830367705ac service glance] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:05.313229 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7331d-6e2b-459e-8105-1830367705ac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:05.322877 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7331d-6e2b-459e-8105-1830367705ac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:05.324356 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7331d-6e2b-459e-8105-1830367705ac service glance] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:05.334660 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 496/1020] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 20:11:06.094147 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e6575-ba28-437d-ad63-fa1c501552ac None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:06.094706 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e6575-ba28-437d-ad63-fa1c501552ac None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:06.094805 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e6575-ba28-437d-ad63-fa1c501552ac None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:06.096334 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 525/1021] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:11:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:06.101728 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adaf5e-0e13-4c6f-9d42-77b451b98340 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:06.102209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adaf5e-0e13-4c6f-9d42-77b451b98340 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:06.102305 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adaf5e-0e13-4c6f-9d42-77b451b98340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:06.124864 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-06adaf5e-0e13-4c6f-9d42-77b451b98340 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:06.126049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-06adaf5e-0e13-4c6f-9d42-77b451b98340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:06.135731 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 497/1022] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:11:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:06.181951 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e6575-ba28-437d-ad63-fa1c501552ac None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:06.196439 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e6575-ba28-437d-ad63-fa1c501552ac None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:06.201279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139e07f-1281-49b4-8c3f-cf85b4dd8df4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:06.201916 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139e07f-1281-49b4-8c3f-cf85b4dd8df4 service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:06.202189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139e07f-1281-49b4-8c3f-cf85b4dd8df4 service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:06.202458 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139e07f-1281-49b4-8c3f-cf85b4dd8df4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:06.211122 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139e07f-1281-49b4-8c3f-cf85b4dd8df4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:06.212879 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139e07f-1281-49b4-8c3f-cf85b4dd8df4 service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:06.223080 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 526/1023] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:08.920184 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ab32-c0a9-4670-a081-25d2dc5869d7 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:08.920860 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ab32-c0a9-4670-a081-25d2dc5869d7 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:08.920860 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ab32-c0a9-4670-a081-25d2dc5869d7 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:08.922087 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 498/1024] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:08.927593 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e437c-02d7-4e46-b338-c5fed290d2be None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:08.928731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e437c-02d7-4e46-b338-c5fed290d2be None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:08.928731 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e437c-02d7-4e46-b338-c5fed290d2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:08.949654 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-c45e437c-02d7-4e46-b338-c5fed290d2be None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:08.956721 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-c45e437c-02d7-4e46-b338-c5fed290d2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:08.964961 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 527/1025] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:11:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:09.012272 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011ab32-c0a9-4670-a081-25d2dc5869d7 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:09.025642 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011ab32-c0a9-4670-a081-25d2dc5869d7 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:09.030586 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735df720-15ca-4cac-ae66-d9f1ad29b242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:09.031230 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735df720-15ca-4cac-ae66-d9f1ad29b242 service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:09.031509 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735df720-15ca-4cac-ae66-d9f1ad29b242 service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:09.031779 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735df720-15ca-4cac-ae66-d9f1ad29b242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:09.040380 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735df720-15ca-4cac-ae66-d9f1ad29b242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:09.045081 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735df720-15ca-4cac-ae66-d9f1ad29b242 service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:09.052213 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 499/1026] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:21.229643 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c51d8d-fb0d-40be-a314-2face5442b3e None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:21.230226 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c51d8d-fb0d-40be-a314-2face5442b3e None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:21.230226 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c51d8d-fb0d-40be-a314-2face5442b3e None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:21.231573 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 528/1027] 10.222.0.58 () {54 vars in 918 bytes} [Fri Apr 29 20:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:21.236862 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cce8f1-444b-475e-9b46-84394a8c54e4 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:21.237336 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cce8f1-444b-475e-9b46-84394a8c54e4 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:21.237433 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cce8f1-444b-475e-9b46-84394a8c54e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:21.255341 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-c5cce8f1-444b-475e-9b46-84394a8c54e4 None None] MFA Rules not processed for user `1d4caa8120a44bc79044e1459759ce4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:21.256606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-c5cce8f1-444b-475e-9b46-84394a8c54e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:21.265468 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 500/1028] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Apr 29 20:11:21 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:21.279497 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a2407-2977-4a03-ac3e-bb6e2ef21689 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:21.279780 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a2407-2977-4a03-ac3e-bb6e2ef21689 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:21.280085 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a2407-2977-4a03-ac3e-bb6e2ef21689 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:21.281406 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 529/1029] 10.222.0.58 () {54 vars in 918 bytes} [Fri Apr 29 20:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:21.285819 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942d355-c741-41ea-961d-2e777bafabc2 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:21.286130 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942d355-c741-41ea-961d-2e777bafabc2 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:21.286405 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942d355-c741-41ea-961d-2e777bafabc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:21.304443 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-7942d355-c741-41ea-961d-2e777bafabc2 None None] MFA Rules not processed for user `ca4e798ccd784e348136af337bf780f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:21.305605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-7942d355-c741-41ea-961d-2e777bafabc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:21.313953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 501/1030] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Apr 29 20:11:21 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:24.080754 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540573e-2b14-46e5-8c5c-ec03ad5664d8 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:24.081268 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540573e-2b14-46e5-8c5c-ec03ad5664d8 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:24.081268 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540573e-2b14-46e5-8c5c-ec03ad5664d8 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:24.082563 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 530/1031] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 20:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:24.087772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa95b44-619e-4991-911f-62bcc15ed148 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:24.088197 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa95b44-619e-4991-911f-62bcc15ed148 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:24.088358 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa95b44-619e-4991-911f-62bcc15ed148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:24.106080 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-7fa95b44-619e-4991-911f-62bcc15ed148 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:24.107256 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-7fa95b44-619e-4991-911f-62bcc15ed148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:24.115088 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 502/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 20:11:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:24.157147 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540573e-2b14-46e5-8c5c-ec03ad5664d8 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:24.170751 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540573e-2b14-46e5-8c5c-ec03ad5664d8 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:24.175606 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c200970-57f9-46ca-90f8-61ba83139fc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:24.176287 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c200970-57f9-46ca-90f8-61ba83139fc3 service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:24.176568 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c200970-57f9-46ca-90f8-61ba83139fc3 service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:24.176866 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c200970-57f9-46ca-90f8-61ba83139fc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:24.185189 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c200970-57f9-46ca-90f8-61ba83139fc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:24.186750 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c200970-57f9-46ca-90f8-61ba83139fc3 service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:24.195807 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 531/1033] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:25.586354 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c125e58-c582-42d4-9107-21a05ddf1c7a None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:25.586918 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c125e58-c582-42d4-9107-21a05ddf1c7a None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:25.586918 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c125e58-c582-42d4-9107-21a05ddf1c7a None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:25.588317 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 503/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 20:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:25.593588 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c1a6c-0f51-41ab-8436-b8835fd5336f None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:25.593997 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c1a6c-0f51-41ab-8436-b8835fd5336f None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:25.594142 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c1a6c-0f51-41ab-8436-b8835fd5336f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:25.612254 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-bf4c1a6c-0f51-41ab-8436-b8835fd5336f None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:25.613371 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-bf4c1a6c-0f51-41ab-8436-b8835fd5336f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:25.621102 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 532/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 20:11:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:25.818453 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c125e58-c582-42d4-9107-21a05ddf1c7a None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:25.831790 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c125e58-c582-42d4-9107-21a05ddf1c7a None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:25.837270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6fc69-a21d-4c07-8d6a-0d31f6b6a991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:25.837891 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6fc69-a21d-4c07-8d6a-0d31f6b6a991 service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:25.838168 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6fc69-a21d-4c07-8d6a-0d31f6b6a991 service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:25.838440 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6fc69-a21d-4c07-8d6a-0d31f6b6a991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:25.846389 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6fc69-a21d-4c07-8d6a-0d31f6b6a991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:25.847951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6fc69-a21d-4c07-8d6a-0d31f6b6a991 service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:25.857154 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 504/1036] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:27.194439 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfc40a-88a5-4830-a3ad-134a51d8d8b5 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:27.195017 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfc40a-88a5-4830-a3ad-134a51d8d8b5 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:27.195017 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfc40a-88a5-4830-a3ad-134a51d8d8b5 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:27.196374 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 533/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 20:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:27.201459 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca995fe6-0d20-4c29-8a4d-5e355a4fe29c None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:27.201849 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca995fe6-0d20-4c29-8a4d-5e355a4fe29c None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:27.202009 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca995fe6-0d20-4c29-8a4d-5e355a4fe29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:27.220191 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-ca995fe6-0d20-4c29-8a4d-5e355a4fe29c None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:27.221394 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-ca995fe6-0d20-4c29-8a4d-5e355a4fe29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:27.229664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 505/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 20:11:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:27.381991 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfc40a-88a5-4830-a3ad-134a51d8d8b5 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:27.395000 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfc40a-88a5-4830-a3ad-134a51d8d8b5 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:27.399887 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d2e14-0784-4652-84e1-9ddbb4c1e0fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:27.400534 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d2e14-0784-4652-84e1-9ddbb4c1e0fb service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:27.400822 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d2e14-0784-4652-84e1-9ddbb4c1e0fb service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:27.401096 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d2e14-0784-4652-84e1-9ddbb4c1e0fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:27.408870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d2e14-0784-4652-84e1-9ddbb4c1e0fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:27.410432 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d2e14-0784-4652-84e1-9ddbb4c1e0fb service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:27.420062 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 534/1039] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:28.715244 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787c457-c05a-4068-87cb-e40b447fec75 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:28.715796 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787c457-c05a-4068-87cb-e40b447fec75 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:28.715796 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787c457-c05a-4068-87cb-e40b447fec75 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:28.717090 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 506/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 20:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:28.722277 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbc7f2-de58-4c97-8bd0-c0d8d9b21008 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:28.722711 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbc7f2-de58-4c97-8bd0-c0d8d9b21008 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:28.722835 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbc7f2-de58-4c97-8bd0-c0d8d9b21008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:28.740636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-e4cbc7f2-de58-4c97-8bd0-c0d8d9b21008 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:28.743065 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-e4cbc7f2-de58-4c97-8bd0-c0d8d9b21008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:28.752257 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 535/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 20:11:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:28.904152 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787c457-c05a-4068-87cb-e40b447fec75 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:28.917538 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787c457-c05a-4068-87cb-e40b447fec75 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:28.922404 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23be78-d49e-4cd3-bf92-04fb5e119344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:28.923108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23be78-d49e-4cd3-bf92-04fb5e119344 service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:28.923391 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23be78-d49e-4cd3-bf92-04fb5e119344 service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:28.923667 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23be78-d49e-4cd3-bf92-04fb5e119344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:28.932395 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23be78-d49e-4cd3-bf92-04fb5e119344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:28.933980 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23be78-d49e-4cd3-bf92-04fb5e119344 service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:28.943020 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 507/1042] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:30.261688 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ba27a-c2b2-4597-ab86-217d8131976e None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:30.262223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ba27a-c2b2-4597-ab86-217d8131976e None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:30.262223 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ba27a-c2b2-4597-ab86-217d8131976e None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:30.263596 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 536/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 20:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:11:30.268544 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf2214-fcd7-4b0c-8e8a-94083db4e734 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:30.268961 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf2214-fcd7-4b0c-8e8a-94083db4e734 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:30.269098 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf2214-fcd7-4b0c-8e8a-94083db4e734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:30.287368 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-f0cf2214-fcd7-4b0c-8e8a-94083db4e734 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:30.288637 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-f0cf2214-fcd7-4b0c-8e8a-94083db4e734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:30.296292 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 508/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 20:11:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:30.450230 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ba27a-c2b2-4597-ab86-217d8131976e None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:30.463783 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ba27a-c2b2-4597-ab86-217d8131976e None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:30.469112 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af97c6-fcc9-4206-b899-d4823419b162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:30.469742 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af97c6-fcc9-4206-b899-d4823419b162 service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:30.470083 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af97c6-fcc9-4206-b899-d4823419b162 service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:30.470358 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af97c6-fcc9-4206-b899-d4823419b162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:30.478288 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af97c6-fcc9-4206-b899-d4823419b162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:30.479856 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af97c6-fcc9-4206-b899-d4823419b162 service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:30.489174 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 537/1045] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:31.783042 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38b774-bccd-4b8e-ae95-058a288e43e9 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:31.783581 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38b774-bccd-4b8e-ae95-058a288e43e9 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:31.783581 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38b774-bccd-4b8e-ae95-058a288e43e9 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:31.784909 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 509/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 20:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:31.789905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd3ead-d6e7-46ed-b2bd-fd71369012ed None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:31.790339 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd3ead-d6e7-46ed-b2bd-fd71369012ed None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:31.790434 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd3ead-d6e7-46ed-b2bd-fd71369012ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:31.807562 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-5dbd3ead-d6e7-46ed-b2bd-fd71369012ed None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:31.808751 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-5dbd3ead-d6e7-46ed-b2bd-fd71369012ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:31.816278 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 538/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 20:11:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:11:31.969636 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38b774-bccd-4b8e-ae95-058a288e43e9 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:31.983090 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38b774-bccd-4b8e-ae95-058a288e43e9 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:31.988026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f18138-f022-48a3-87a4-60c8f5ba5d4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:31.988700 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f18138-f022-48a3-87a4-60c8f5ba5d4d service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:31.989093 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f18138-f022-48a3-87a4-60c8f5ba5d4d service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:31.989372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f18138-f022-48a3-87a4-60c8f5ba5d4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:31.997451 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f18138-f022-48a3-87a4-60c8f5ba5d4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:31.999012 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f18138-f022-48a3-87a4-60c8f5ba5d4d service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:32.008944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 510/1048] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:33.303810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1f77f-28bb-49b8-a8bd-a8f1f44d905b None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:33.304493 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1f77f-28bb-49b8-a8bd-a8f1f44d905b None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:33.304493 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1f77f-28bb-49b8-a8bd-a8f1f44d905b None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:33.305770 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 539/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 20:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:33.310816 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a529cd-1d3e-44f0-af52-f80812df9794 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:33.311215 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a529cd-1d3e-44f0-af52-f80812df9794 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:33.311403 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a529cd-1d3e-44f0-af52-f80812df9794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:33.329540 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-a3a529cd-1d3e-44f0-af52-f80812df9794 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:33.330731 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-a3a529cd-1d3e-44f0-af52-f80812df9794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:33.339162 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 511/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 20:11:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:33.489600 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1f77f-28bb-49b8-a8bd-a8f1f44d905b None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:33.502708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1f77f-28bb-49b8-a8bd-a8f1f44d905b None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:33.508190 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1aa8f0-9e8a-4717-9bcd-26d64c621804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:33.508818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aa8f0-9e8a-4717-9bcd-26d64c621804 service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:33.509098 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aa8f0-9e8a-4717-9bcd-26d64c621804 service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:33.509372 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aa8f0-9e8a-4717-9bcd-26d64c621804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:33.517192 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1aa8f0-9e8a-4717-9bcd-26d64c621804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:33.518764 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1aa8f0-9e8a-4717-9bcd-26d64c621804 service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:33.528504 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 540/1051] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:34.833761 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515f57-a1ce-44d9-af46-ea5d169e07a0 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:34.834362 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515f57-a1ce-44d9-af46-ea5d169e07a0 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:34.834362 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515f57-a1ce-44d9-af46-ea5d169e07a0 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:34.836252 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 512/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 20:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:34.841169 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cea4b1-3c89-42ba-b659-6b98651ddc6b None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:34.841586 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cea4b1-3c89-42ba-b659-6b98651ddc6b None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:34.841813 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cea4b1-3c89-42ba-b659-6b98651ddc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:34.860420 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-a5cea4b1-3c89-42ba-b659-6b98651ddc6b None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:34.861601 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-a5cea4b1-3c89-42ba-b659-6b98651ddc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:34.869323 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 541/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 20:11:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:11:35.021227 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35515f57-a1ce-44d9-af46-ea5d169e07a0 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:35.034841 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35515f57-a1ce-44d9-af46-ea5d169e07a0 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:35.039676 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74319dfb-ce97-4566-9f7f-02b0a76b7a3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:35.040329 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74319dfb-ce97-4566-9f7f-02b0a76b7a3a service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:35.040608 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74319dfb-ce97-4566-9f7f-02b0a76b7a3a service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:35.040888 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74319dfb-ce97-4566-9f7f-02b0a76b7a3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:35.048731 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74319dfb-ce97-4566-9f7f-02b0a76b7a3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:35.050302 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74319dfb-ce97-4566-9f7f-02b0a76b7a3a service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:35.059799 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 513/1054] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:36.406326 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e728ca3-0a4f-4690-b2db-01bc733e569f None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:36.406851 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e728ca3-0a4f-4690-b2db-01bc733e569f None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:36.406851 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e728ca3-0a4f-4690-b2db-01bc733e569f None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:36.408152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 542/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 20:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:36.413243 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc138-fd10-4424-98c7-5be2f43d45e2 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:36.415418 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc138-fd10-4424-98c7-5be2f43d45e2 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:36.415418 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc138-fd10-4424-98c7-5be2f43d45e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:36.432606 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-492bc138-fd10-4424-98c7-5be2f43d45e2 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:36.433817 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-492bc138-fd10-4424-98c7-5be2f43d45e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:36.442182 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 514/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 20:11:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:36.598308 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e728ca3-0a4f-4690-b2db-01bc733e569f None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:36.611217 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e728ca3-0a4f-4690-b2db-01bc733e569f None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:36.616570 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44304bd1-1fd4-43da-87dd-949f165a63d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:36.617193 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44304bd1-1fd4-43da-87dd-949f165a63d9 service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:36.617467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44304bd1-1fd4-43da-87dd-949f165a63d9 service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:36.617736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44304bd1-1fd4-43da-87dd-949f165a63d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:36.625559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44304bd1-1fd4-43da-87dd-949f165a63d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:36.627129 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44304bd1-1fd4-43da-87dd-949f165a63d9 service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:36.636937 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 543/1057] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:38.868509 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f68f74-eb11-43f4-812d-c2b1e77f27fd None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:38.869188 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f68f74-eb11-43f4-812d-c2b1e77f27fd None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:38.869188 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f68f74-eb11-43f4-812d-c2b1e77f27fd None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:38.870439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 515/1058] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 20:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:38.875760 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733d20c-b427-486d-844a-fa0bd0469460 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:38.876247 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733d20c-b427-486d-844a-fa0bd0469460 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:38.876350 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733d20c-b427-486d-844a-fa0bd0469460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:38.893476 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-8733d20c-b427-486d-844a-fa0bd0469460 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:38.894649 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-8733d20c-b427-486d-844a-fa0bd0469460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:38.907018 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 544/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 20:11:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:11:38.951160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f68f74-eb11-43f4-812d-c2b1e77f27fd None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:38.960246 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f68f74-eb11-43f4-812d-c2b1e77f27fd None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:38.963748 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414e6c7-3c67-4a15-8670-34d0119943b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:38.964412 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414e6c7-3c67-4a15-8670-34d0119943b9 service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:38.964691 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414e6c7-3c67-4a15-8670-34d0119943b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:38.964962 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414e6c7-3c67-4a15-8670-34d0119943b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:38.973980 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414e6c7-3c67-4a15-8670-34d0119943b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:38.976045 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414e6c7-3c67-4a15-8670-34d0119943b9 service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:38.985128 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 516/1060] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:41.438245 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bd9ad-2bd3-42ff-9953-88481facf96f None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:41.438795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bd9ad-2bd3-42ff-9953-88481facf96f None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:41.438795 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bd9ad-2bd3-42ff-9953-88481facf96f None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:41.440231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 545/1061] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 20:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:41.445399 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05433f-c3ce-477a-9988-4326921bea24 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:41.445786 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05433f-c3ce-477a-9988-4326921bea24 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:41.445951 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05433f-c3ce-477a-9988-4326921bea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:41.462918 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-ae05433f-c3ce-477a-9988-4326921bea24 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:41.464122 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-ae05433f-c3ce-477a-9988-4326921bea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:41.471888 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 517/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 20:11:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:41.517538 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bd9ad-2bd3-42ff-9953-88481facf96f None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:41.528377 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bd9ad-2bd3-42ff-9953-88481facf96f None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:41.531796 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca80f6-1669-494e-a151-948784002f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:41.532472 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca80f6-1669-494e-a151-948784002f58 service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:41.532748 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca80f6-1669-494e-a151-948784002f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:41.533018 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca80f6-1669-494e-a151-948784002f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:41.542527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca80f6-1669-494e-a151-948784002f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:41.543999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca80f6-1669-494e-a151-948784002f58 service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:41.553814 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 546/1063] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:44.238470 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50eb27-13bc-4ab1-a6b4-4bcdca42596a None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:44.239025 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50eb27-13bc-4ab1-a6b4-4bcdca42596a None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:44.239025 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50eb27-13bc-4ab1-a6b4-4bcdca42596a None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:44.240416 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 518/1064] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 20:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:44.246039 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec5a95-5c51-459b-997f-b2878358d0b2 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:44.246427 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec5a95-5c51-459b-997f-b2878358d0b2 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:44.246581 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec5a95-5c51-459b-997f-b2878358d0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:44.263610 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-feec5a95-5c51-459b-997f-b2878358d0b2 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:44.264813 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-feec5a95-5c51-459b-997f-b2878358d0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:44.272932 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 547/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 20:11:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:11:44.311162 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50eb27-13bc-4ab1-a6b4-4bcdca42596a None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:44.321414 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50eb27-13bc-4ab1-a6b4-4bcdca42596a None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:44.326269 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76580b4-24c2-49f7-8450-cfe00716e5e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:44.326269 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76580b4-24c2-49f7-8450-cfe00716e5e7 service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:44.326269 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76580b4-24c2-49f7-8450-cfe00716e5e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:44.326269 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76580b4-24c2-49f7-8450-cfe00716e5e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:44.334928 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76580b4-24c2-49f7-8450-cfe00716e5e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:44.336372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76580b4-24c2-49f7-8450-cfe00716e5e7 service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:44.345717 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 519/1066] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:46.828806 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341b295-c256-46ec-9a74-9a6041b1bd60 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:46.829352 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341b295-c256-46ec-9a74-9a6041b1bd60 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:46.829475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341b295-c256-46ec-9a74-9a6041b1bd60 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:46.830814 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 548/1067] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 20:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:46.836059 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281a75c-2e39-48e7-b292-e82a4c96b597 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:46.836498 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281a75c-2e39-48e7-b292-e82a4c96b597 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:46.836602 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281a75c-2e39-48e7-b292-e82a4c96b597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:46.854586 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-0281a75c-2e39-48e7-b292-e82a4c96b597 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:46.855836 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-0281a75c-2e39-48e7-b292-e82a4c96b597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:46.863539 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 520/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 20:11:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:46.904296 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341b295-c256-46ec-9a74-9a6041b1bd60 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:46.915135 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341b295-c256-46ec-9a74-9a6041b1bd60 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:46.918571 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b8f34-379b-4f2c-ae7e-7b8e70ff9c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:46.919194 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b8f34-379b-4f2c-ae7e-7b8e70ff9c28 service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:46.919483 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b8f34-379b-4f2c-ae7e-7b8e70ff9c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:46.919769 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b8f34-379b-4f2c-ae7e-7b8e70ff9c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:46.929027 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b8f34-379b-4f2c-ae7e-7b8e70ff9c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:46.930462 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b8f34-379b-4f2c-ae7e-7b8e70ff9c28 service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:46.940227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 549/1069] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:49.483157 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d125c-9808-4d87-910c-463cc5690083 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:49.483715 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d125c-9808-4d87-910c-463cc5690083 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:49.483715 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d125c-9808-4d87-910c-463cc5690083 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:49.485139 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 521/1070] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 20:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:49.490959 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79f5f4-3d8f-4801-a473-cacd4048f1ed None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:49.491425 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79f5f4-3d8f-4801-a473-cacd4048f1ed None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:49.491529 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79f5f4-3d8f-4801-a473-cacd4048f1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:49.509173 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-cf79f5f4-3d8f-4801-a473-cacd4048f1ed None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:49.510349 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-cf79f5f4-3d8f-4801-a473-cacd4048f1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:49.518024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 550/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 20:11:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:49.556795 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d125c-9808-4d87-910c-463cc5690083 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:49.567082 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d125c-9808-4d87-910c-463cc5690083 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:49.571138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b1010-18a2-478f-9029-a70bc696f4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:49.571756 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b1010-18a2-478f-9029-a70bc696f4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:49.572069 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b1010-18a2-478f-9029-a70bc696f4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:49.572340 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b1010-18a2-478f-9029-a70bc696f4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:49.580822 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b1010-18a2-478f-9029-a70bc696f4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:49.582220 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b1010-18a2-478f-9029-a70bc696f4a4 service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:49.591225 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 522/1072] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:51.930789 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52382121-eea4-434d-ae81-bf669e3d6e22 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:51.931335 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52382121-eea4-434d-ae81-bf669e3d6e22 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:51.931335 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52382121-eea4-434d-ae81-bf669e3d6e22 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:51.932766 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 551/1073] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 20:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:51.938107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dcdf6-026f-4bc1-91f5-1eece4760392 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:51.938563 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dcdf6-026f-4bc1-91f5-1eece4760392 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:51.938659 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dcdf6-026f-4bc1-91f5-1eece4760392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:51.956923 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-a29dcdf6-026f-4bc1-91f5-1eece4760392 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:51.958108 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-a29dcdf6-026f-4bc1-91f5-1eece4760392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:51.966446 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 523/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 20:11:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:11:52.003706 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52382121-eea4-434d-ae81-bf669e3d6e22 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:52.014658 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52382121-eea4-434d-ae81-bf669e3d6e22 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:52.018107 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47097d85-4c53-4bce-aae0-b066ea8f792f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:52.018732 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47097d85-4c53-4bce-aae0-b066ea8f792f service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:52.019011 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47097d85-4c53-4bce-aae0-b066ea8f792f service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:52.019283 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47097d85-4c53-4bce-aae0-b066ea8f792f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:52.028694 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47097d85-4c53-4bce-aae0-b066ea8f792f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:52.030110 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47097d85-4c53-4bce-aae0-b066ea8f792f service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:52.039154 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 552/1075] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:54.398903 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04653e-f22c-4045-93f9-d128acb16d4e None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:54.399425 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04653e-f22c-4045-93f9-d128acb16d4e None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:54.399425 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04653e-f22c-4045-93f9-d128acb16d4e None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:54.400772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 524/1076] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 20:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:54.405959 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc8647-4ede-4aee-88c6-3b103c1bdf37 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:54.406388 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc8647-4ede-4aee-88c6-3b103c1bdf37 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:54.406578 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc8647-4ede-4aee-88c6-3b103c1bdf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:54.424488 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-77bc8647-4ede-4aee-88c6-3b103c1bdf37 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:54.425669 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-77bc8647-4ede-4aee-88c6-3b103c1bdf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:54.434325 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 553/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 20:11:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:54.472381 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04653e-f22c-4045-93f9-d128acb16d4e None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:54.483289 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04653e-f22c-4045-93f9-d128acb16d4e None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:54.486746 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc2462-f05d-4f6d-b384-58da98095d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:54.487372 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc2462-f05d-4f6d-b384-58da98095d4f service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:54.487652 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc2462-f05d-4f6d-b384-58da98095d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:54.487929 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc2462-f05d-4f6d-b384-58da98095d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:54.497332 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc2462-f05d-4f6d-b384-58da98095d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:54.498752 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc2462-f05d-4f6d-b384-58da98095d4f service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:54.508270 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 525/1078] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:56.823364 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613013d-3882-47d0-95cf-ed0746fb7896 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:56.823933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613013d-3882-47d0-95cf-ed0746fb7896 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:56.823933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613013d-3882-47d0-95cf-ed0746fb7896 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:56.825298 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 554/1079] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 20:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:56.830654 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d43549-a840-433c-86cb-0f2dc66b49be None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:56.831077 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d43549-a840-433c-86cb-0f2dc66b49be None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:56.831209 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d43549-a840-433c-86cb-0f2dc66b49be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:56.848522 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-c8d43549-a840-433c-86cb-0f2dc66b49be None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:56.849714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-c8d43549-a840-433c-86cb-0f2dc66b49be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:56.857377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 526/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 20:11:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:56.895336 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613013d-3882-47d0-95cf-ed0746fb7896 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:56.911040 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613013d-3882-47d0-95cf-ed0746fb7896 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:56.914651 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1701c9-b70e-4a4a-a6e7-440d25dbfe29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:56.915289 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1701c9-b70e-4a4a-a6e7-440d25dbfe29 service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:56.915568 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1701c9-b70e-4a4a-a6e7-440d25dbfe29 service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:56.915837 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1701c9-b70e-4a4a-a6e7-440d25dbfe29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:56.925328 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1701c9-b70e-4a4a-a6e7-440d25dbfe29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:56.926766 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1701c9-b70e-4a4a-a6e7-440d25dbfe29 service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:56.936730 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 555/1081] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:11:59.311441 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51413a32-2931-472a-829f-d1fee87cc613 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:59.312027 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51413a32-2931-472a-829f-d1fee87cc613 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:59.312027 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51413a32-2931-472a-829f-d1fee87cc613 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:59.313449 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 527/1082] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 20:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:11:59.318919 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceac8ea-f6a7-40e2-8bed-715d633d9dc1 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:59.319368 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceac8ea-f6a7-40e2-8bed-715d633d9dc1 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:59.319815 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceac8ea-f6a7-40e2-8bed-715d633d9dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:59.337813 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-cceac8ea-f6a7-40e2-8bed-715d633d9dc1 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:11:59.338999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-cceac8ea-f6a7-40e2-8bed-715d633d9dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:11:59.347274 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 556/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 20:11:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:11:59.385513 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51413a32-2931-472a-829f-d1fee87cc613 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:11:59.395815 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51413a32-2931-472a-829f-d1fee87cc613 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:11:59.399830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f966d-49d4-4a38-9e89-256dc786a99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:11:59.400490 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f966d-49d4-4a38-9e89-256dc786a99a service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:11:59.400767 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f966d-49d4-4a38-9e89-256dc786a99a service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:11:59.401037 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f966d-49d4-4a38-9e89-256dc786a99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:11:59.409648 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f966d-49d4-4a38-9e89-256dc786a99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:11:59.411060 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f966d-49d4-4a38-9e89-256dc786a99a service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:11:59.420944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 528/1084] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:11:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:12:01.729503 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e769e-51fc-41df-b639-6046ad0dde06 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:01.730031 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e769e-51fc-41df-b639-6046ad0dde06 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:01.730031 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e769e-51fc-41df-b639-6046ad0dde06 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:01.731308 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 557/1085] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 20:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:12:01.736677 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd2ca5-85ec-4493-b746-690bc482e449 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:01.737144 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd2ca5-85ec-4493-b746-690bc482e449 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:01.737255 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd2ca5-85ec-4493-b746-690bc482e449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:01.754316 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-52fd2ca5-85ec-4493-b746-690bc482e449 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:12:01.755500 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-52fd2ca5-85ec-4493-b746-690bc482e449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:12:01.763667 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 529/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 20:12:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:12:01.800600 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e769e-51fc-41df-b639-6046ad0dde06 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:12:01.810862 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e769e-51fc-41df-b639-6046ad0dde06 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:12:01.814292 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedde972-7285-4cf8-9824-2a9c144ce8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:12:01.814918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedde972-7285-4cf8-9824-2a9c144ce8dd service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:01.815213 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedde972-7285-4cf8-9824-2a9c144ce8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:01.815466 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedde972-7285-4cf8-9824-2a9c144ce8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:01.824661 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedde972-7285-4cf8-9824-2a9c144ce8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:12:01.826113 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedde972-7285-4cf8-9824-2a9c144ce8dd service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:12:01.836058 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 558/1087] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:12:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:12:37.101097 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d2f62-2798-4ba7-b38c-de8345a91086 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:37.101717 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d2f62-2798-4ba7-b38c-de8345a91086 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:37.101717 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d2f62-2798-4ba7-b38c-de8345a91086 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:37.103008 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 530/1088] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:12:37.108111 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ca66f-007d-4ec9-aacb-4df6c375939e None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:37.108528 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ca66f-007d-4ec9-aacb-4df6c375939e None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:37.108665 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ca66f-007d-4ec9-aacb-4df6c375939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:37.125720 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-ef5ca66f-007d-4ec9-aacb-4df6c375939e None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:12:37.126888 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-ef5ca66f-007d-4ec9-aacb-4df6c375939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:12:37.135208 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 559/1089] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:12:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:12:37.185181 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b055bae-2a54-4656-8c50-f417bb96ae75 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:37.185466 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b055bae-2a54-4656-8c50-f417bb96ae75 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:37.185740 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b055bae-2a54-4656-8c50-f417bb96ae75 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:37.187191 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 531/1090] 10.222.0.58 () {54 vars in 962 bytes} [Fri Apr 29 20:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:12:37.192487 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090c403-563d-4134-9cd9-e50ffc0ea2bd None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:37.192775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090c403-563d-4134-9cd9-e50ffc0ea2bd None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:37.193051 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090c403-563d-4134-9cd9-e50ffc0ea2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:37.211660 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-e090c403-563d-4134-9cd9-e50ffc0ea2bd None None] MFA Rules not processed for user `685208fceb044edb9970003b5225f3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:12:37.214138 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-e090c403-563d-4134-9cd9-e50ffc0ea2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:12:37.219561 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 560/1091] 10.222.0.58 () {58 vars in 1059 bytes} [Fri Apr 29 20:12:37 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:12:37.226883 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b055bae-2a54-4656-8c50-f417bb96ae75 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:12:37.237439 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b055bae-2a54-4656-8c50-f417bb96ae75 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:12:37.240921 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141111e0-0e85-49e8-831a-47d9c7dec5f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685208fceb044edb9970003b5225f3ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:12:37.242175 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141111e0-0e85-49e8-831a-47d9c7dec5f3 service glance] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:37.242478 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141111e0-0e85-49e8-831a-47d9c7dec5f3 service glance] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:37.242747 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141111e0-0e85-49e8-831a-47d9c7dec5f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:37.251465 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141111e0-0e85-49e8-831a-47d9c7dec5f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:12:37.252905 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141111e0-0e85-49e8-831a-47d9c7dec5f3 service glance] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:12:37.262581 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 532/1092] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:12:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:12:39.649247 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5367b-c17f-40fa-a6d8-903501026500 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:39.649788 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5367b-c17f-40fa-a6d8-903501026500 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:39.649788 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5367b-c17f-40fa-a6d8-903501026500 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:39.651054 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 561/1093] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:12:39.656284 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c0971-c5ae-4afc-a742-3b50d2145b2f None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:39.656695 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c0971-c5ae-4afc-a742-3b50d2145b2f None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:39.656830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c0971-c5ae-4afc-a742-3b50d2145b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:39.674557 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-a91c0971-c5ae-4afc-a742-3b50d2145b2f None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:12:39.675776 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-a91c0971-c5ae-4afc-a742-3b50d2145b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:12:39.683414 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 533/1094] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:12:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:12:39.707968 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5367b-c17f-40fa-a6d8-903501026500 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:12:39.720941 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5367b-c17f-40fa-a6d8-903501026500 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:12:39.725422 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f8159-9262-470c-bc28-48e7184f14d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:12:39.726692 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f8159-9262-470c-bc28-48e7184f14d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:39.726968 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f8159-9262-470c-bc28-48e7184f14d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:39.727233 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f8159-9262-470c-bc28-48e7184f14d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:39.727950 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f8159-9262-470c-bc28-48e7184f14d0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:12:39.729705 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: WARNING py.warnings [None req-a24f8159-9262-470c-bc28-48e7184f14d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 20:12:39.729705 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: warnings.warn(msg) Apr 29 20:12:39.729705 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: Apr 29 20:12:39.730889 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f8159-9262-470c-bc28-48e7184f14d0 admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:12:39.748227 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 562/1095] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Apr 29 20:12:39 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 20:12:42.064786 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229c4fe-c7e2-4e11-9ca9-b0b9a3dde40a None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:42.065385 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229c4fe-c7e2-4e11-9ca9-b0b9a3dde40a None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:42.065385 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229c4fe-c7e2-4e11-9ca9-b0b9a3dde40a None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:42.066719 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 534/1096] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:12:42.072671 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b526035-23fc-4cf5-8407-03123a6f2efb None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:42.073109 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b526035-23fc-4cf5-8407-03123a6f2efb None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:42.073248 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b526035-23fc-4cf5-8407-03123a6f2efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:42.090302 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-2b526035-23fc-4cf5-8407-03123a6f2efb None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:12:42.091475 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-2b526035-23fc-4cf5-8407-03123a6f2efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:12:42.099367 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 563/1097] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:12:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:12:42.141620 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229c4fe-c7e2-4e11-9ca9-b0b9a3dde40a None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:12:42.154672 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229c4fe-c7e2-4e11-9ca9-b0b9a3dde40a None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:12:42.159543 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddbe91-ef95-4abb-8e27-796968e43a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:12:42.160201 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddbe91-ef95-4abb-8e27-796968e43a0d service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:42.160481 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddbe91-ef95-4abb-8e27-796968e43a0d service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:42.160800 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddbe91-ef95-4abb-8e27-796968e43a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:42.169139 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddbe91-ef95-4abb-8e27-796968e43a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:12:42.170725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddbe91-ef95-4abb-8e27-796968e43a0d service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:12:42.180498 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 535/1098] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:12:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:12:44.650388 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a280cf8-12c4-45cc-95a5-9129854e1ba8 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:44.650990 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a280cf8-12c4-45cc-95a5-9129854e1ba8 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:44.651342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a280cf8-12c4-45cc-95a5-9129854e1ba8 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:44.653307 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 564/1099] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:12:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:12:44.658517 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fe580-7cf9-4299-ade8-0f8e0a20a317 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:44.659004 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fe580-7cf9-4299-ade8-0f8e0a20a317 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:44.659100 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fe580-7cf9-4299-ade8-0f8e0a20a317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:44.676668 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-329fe580-7cf9-4299-ade8-0f8e0a20a317 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:12:44.677867 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-329fe580-7cf9-4299-ade8-0f8e0a20a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:12:44.685593 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 536/1100] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:12:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:12:44.727122 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a280cf8-12c4-45cc-95a5-9129854e1ba8 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:12:44.737458 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a280cf8-12c4-45cc-95a5-9129854e1ba8 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:12:44.740926 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c11ce-4211-466b-bef0-fbdef683983e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:12:44.742046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c11ce-4211-466b-bef0-fbdef683983e service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:44.742326 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c11ce-4211-466b-bef0-fbdef683983e service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:44.742600 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c11ce-4211-466b-bef0-fbdef683983e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:44.751156 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c11ce-4211-466b-bef0-fbdef683983e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:12:44.752614 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c11ce-4211-466b-bef0-fbdef683983e service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:12:44.762592 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 565/1101] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:12:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:12:47.133033 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56039ec8-91ff-4f98-b97b-0383bae53c3b None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:47.133605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56039ec8-91ff-4f98-b97b-0383bae53c3b None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:47.133605 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56039ec8-91ff-4f98-b97b-0383bae53c3b None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:47.134934 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 537/1102] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:12:47.140108 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e5bc6-5961-41fa-8a7a-9b4fcf0417ff None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:47.140557 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e5bc6-5961-41fa-8a7a-9b4fcf0417ff None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:47.140652 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e5bc6-5961-41fa-8a7a-9b4fcf0417ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:47.158212 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-fe1e5bc6-5961-41fa-8a7a-9b4fcf0417ff None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:12:47.159368 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-fe1e5bc6-5961-41fa-8a7a-9b4fcf0417ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:12:47.167558 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 566/1103] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:12:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:12:47.205347 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56039ec8-91ff-4f98-b97b-0383bae53c3b None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:12:47.216183 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56039ec8-91ff-4f98-b97b-0383bae53c3b None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:12:47.219877 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb89165-b6bf-42e0-abda-0d330640179c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:12:47.220585 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb89165-b6bf-42e0-abda-0d330640179c service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:47.220859 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb89165-b6bf-42e0-abda-0d330640179c service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:47.221130 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb89165-b6bf-42e0-abda-0d330640179c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:47.230694 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb89165-b6bf-42e0-abda-0d330640179c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:12:47.232382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb89165-b6bf-42e0-abda-0d330640179c service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:12:47.241584 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 538/1104] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:12:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:12:49.675459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aa403-e756-4e69-9ba8-313538a440d8 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:49.676024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aa403-e756-4e69-9ba8-313538a440d8 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:49.676024 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aa403-e756-4e69-9ba8-313538a440d8 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:49.677320 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 567/1105] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:12:49.682633 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b980819-b195-4f58-9cdb-b9646fcfc1e7 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:49.683049 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b980819-b195-4f58-9cdb-b9646fcfc1e7 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:49.683174 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b980819-b195-4f58-9cdb-b9646fcfc1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:49.701027 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-0b980819-b195-4f58-9cdb-b9646fcfc1e7 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:12:49.702184 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-0b980819-b195-4f58-9cdb-b9646fcfc1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:12:49.710420 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 539/1106] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:12:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:12:49.750802 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29aa403-e756-4e69-9ba8-313538a440d8 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:12:49.762155 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29aa403-e756-4e69-9ba8-313538a440d8 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:12:49.765701 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455273e-897c-4240-8a33-05390a1c9daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:12:49.766343 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455273e-897c-4240-8a33-05390a1c9daa service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:49.766626 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455273e-897c-4240-8a33-05390a1c9daa service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:49.766902 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455273e-897c-4240-8a33-05390a1c9daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:49.777607 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455273e-897c-4240-8a33-05390a1c9daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:12:49.779042 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455273e-897c-4240-8a33-05390a1c9daa service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:12:49.788428 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 568/1107] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:12:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:12:52.474771 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a15a4-6945-4fff-bcff-654bff2c2f60 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:52.475932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a15a4-6945-4fff-bcff-654bff2c2f60 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:52.475932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a15a4-6945-4fff-bcff-654bff2c2f60 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:52.477286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 540/1108] 10.222.0.58 () {54 vars in 926 bytes} [Fri Apr 29 20:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:12:52.482529 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0592d-bf8e-4c40-be28-05c4a6ae349a None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:52.482959 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0592d-bf8e-4c40-be28-05c4a6ae349a None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:52.483063 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0592d-bf8e-4c40-be28-05c4a6ae349a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:52.500460 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-2de0592d-bf8e-4c40-be28-05c4a6ae349a None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:12:52.501628 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-2de0592d-bf8e-4c40-be28-05c4a6ae349a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:12:52.509481 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 569/1109] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Apr 29 20:12:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:12:52.549416 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a15a4-6945-4fff-bcff-654bff2c2f60 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:12:52.559736 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a15a4-6945-4fff-bcff-654bff2c2f60 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:12:52.563182 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac0dcd-690e-4e22-8721-50efe4aeaacc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:12:52.563810 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac0dcd-690e-4e22-8721-50efe4aeaacc service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:12:52.564126 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac0dcd-690e-4e22-8721-50efe4aeaacc service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:12:52.564400 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac0dcd-690e-4e22-8721-50efe4aeaacc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:12:52.573659 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac0dcd-690e-4e22-8721-50efe4aeaacc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:12:52.575083 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac0dcd-690e-4e22-8721-50efe4aeaacc service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:12:52.584154 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 541/1110] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:12:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:14:51.364392 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdaad9-259d-475e-8029-e4ebc9373324 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:14:51.364943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdaad9-259d-475e-8029-e4ebc9373324 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:14:51.364943 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdaad9-259d-475e-8029-e4ebc9373324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:14:51.383249 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-95bdaad9-259d-475e-8029-e4ebc9373324 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:14:51.384461 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-95bdaad9-259d-475e-8029-e4ebc9373324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:14:51.392210 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 570/1111] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:14:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:14:51.400406 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89252a-2b93-4376-aa98-d6ce774f5998 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:14:51.400900 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89252a-2b93-4376-aa98-d6ce774f5998 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:14:51.400997 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89252a-2b93-4376-aa98-d6ce774f5998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:14:51.418701 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-3b89252a-2b93-4376-aa98-d6ce774f5998 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:14:51.419880 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-3b89252a-2b93-4376-aa98-d6ce774f5998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:14:51.427595 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 542/1112] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:14:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:14:51.431805 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdaad9-259d-475e-8029-e4ebc9373324 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:14:51.440923 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdaad9-259d-475e-8029-e4ebc9373324 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:14:51.445301 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da6bee-2cd5-4054-8a76-ea1b37e3fbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:14:51.445935 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da6bee-2cd5-4054-8a76-ea1b37e3fbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:14:51.446206 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da6bee-2cd5-4054-8a76-ea1b37e3fbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:14:51.446468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da6bee-2cd5-4054-8a76-ea1b37e3fbc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:14:51.447160 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da6bee-2cd5-4054-8a76-ea1b37e3fbc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:14:51.447455 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da6bee-2cd5-4054-8a76-ea1b37e3fbc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:14:51.448480 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: WARNING py.warnings [None req-e3da6bee-2cd5-4054-8a76-ea1b37e3fbc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 20:14:51.448480 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: warnings.warn(msg) Apr 29 20:14:51.448480 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: Apr 29 20:14:51.449360 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da6bee-2cd5-4054-8a76-ea1b37e3fbc3 admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:14:51.460148 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 571/1113] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Apr 29 20:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:14:51.468580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89252a-2b93-4376-aa98-d6ce774f5998 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:14:51.477888 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89252a-2b93-4376-aa98-d6ce774f5998 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:14:51.482445 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8704c2-ce1c-4d38-aba9-66084a4eec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:14:51.483082 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8704c2-ce1c-4d38-aba9-66084a4eec80 admin admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:14:51.483363 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8704c2-ce1c-4d38-aba9-66084a4eec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:14:51.483638 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8704c2-ce1c-4d38-aba9-66084a4eec80 admin admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:14:51.484355 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8704c2-ce1c-4d38-aba9-66084a4eec80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:14:51.486087 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: WARNING py.warnings [None req-8a8704c2-ce1c-4d38-aba9-66084a4eec80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 20:14:51.486087 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: warnings.warn(msg) Apr 29 20:14:51.486087 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: Apr 29 20:14:51.487279 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8704c2-ce1c-4d38-aba9-66084a4eec80 admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:14:51.580086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 543/1114] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Apr 29 20:14:51 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:14:51.584321 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da6bee-2cd5-4054-8a76-ea1b37e3fbc3 admin admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:14:51.594820 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da6bee-2cd5-4054-8a76-ea1b37e3fbc3 admin admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:14:51.648070 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f835c-98a7-43e9-add2-7984cbe8d78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:14:51.648726 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f835c-98a7-43e9-add2-7984cbe8d78e admin admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:14:51.648997 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f835c-98a7-43e9-add2-7984cbe8d78e admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:14:51.649260 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f835c-98a7-43e9-add2-7984cbe8d78e admin admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:14:51.649927 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f835c-98a7-43e9-add2-7984cbe8d78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:14:51.650923 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: WARNING py.warnings [None req-864f835c-98a7-43e9-add2-7984cbe8d78e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 20:14:51.650923 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: warnings.warn(msg) Apr 29 20:14:51.650923 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: Apr 29 20:14:51.652140 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f835c-98a7-43e9-add2-7984cbe8d78e admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:14:51.731207 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 572/1115] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Apr 29 20:14:51 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 29 20:14:51.735221 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8704c2-ce1c-4d38-aba9-66084a4eec80 admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:14:51.746492 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8704c2-ce1c-4d38-aba9-66084a4eec80 admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:14:51.751066 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d7461-9a34-47a0-ac70-46a11c2252b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:14:51.751716 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d7461-9a34-47a0-ac70-46a11c2252b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:14:51.752023 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d7461-9a34-47a0-ac70-46a11c2252b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:14:51.752303 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d7461-9a34-47a0-ac70-46a11c2252b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:14:51.753020 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d7461-9a34-47a0-ac70-46a11c2252b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:14:51.754032 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: WARNING py.warnings [None req-4f4d7461-9a34-47a0-ac70-46a11c2252b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 20:14:51.754032 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: warnings.warn(msg) Apr 29 20:14:51.754032 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: Apr 29 20:14:51.754915 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d7461-9a34-47a0-ac70-46a11c2252b4 admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:14:51.767388 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 544/1116] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Apr 29 20:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 20:14:51.771208 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f835c-98a7-43e9-add2-7984cbe8d78e admin admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:14:51.781048 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f835c-98a7-43e9-add2-7984cbe8d78e admin admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:14:51.785635 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66217d55-d13a-4ee9-aeb0-f2c0c92d26ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:14:51.786279 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66217d55-d13a-4ee9-aeb0-f2c0c92d26ef admin admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:14:51.786700 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66217d55-d13a-4ee9-aeb0-f2c0c92d26ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:14:51.786920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66217d55-d13a-4ee9-aeb0-f2c0c92d26ef admin admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:14:51.787631 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66217d55-d13a-4ee9-aeb0-f2c0c92d26ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:14:51.789167 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: WARNING py.warnings [None req-66217d55-d13a-4ee9-aeb0-f2c0c92d26ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 20:14:51.789167 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: warnings.warn(msg) Apr 29 20:14:51.789167 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: Apr 29 20:14:51.790042 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66217d55-d13a-4ee9-aeb0-f2c0c92d26ef admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:14:51.803247 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 573/1117] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Apr 29 20:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 20:14:51.807934 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d7461-9a34-47a0-ac70-46a11c2252b4 admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:14:51.817504 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d7461-9a34-47a0-ac70-46a11c2252b4 admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:14:51.822122 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355729f-36a0-4d8a-a686-30af8bfd7a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:14:51.823042 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355729f-36a0-4d8a-a686-30af8bfd7a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:14:51.823347 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355729f-36a0-4d8a-a686-30af8bfd7a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:14:51.823618 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355729f-36a0-4d8a-a686-30af8bfd7a84 admin admin] PATH_INFO: `/v3/projects/dd9e05e8defb49b0b27722f93db09942/users/c3ec09b16e584483bbca3fe678ba5544/roles/a2a640f930c44b2fa40f432179d7faa4` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:14:51.837657 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355729f-36a0-4d8a-a686-30af8bfd7a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9e05e8defb49b0b27722f93db09942, user_id=c3ec09b16e584483bbca3fe678ba5544, role_id=a2a640f930c44b2fa40f432179d7faa4)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:14:51.838662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: WARNING py.warnings [None req-b355729f-36a0-4d8a-a686-30af8bfd7a84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 20:14:51.838662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: warnings.warn(msg) Apr 29 20:14:51.838662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: Apr 29 20:14:51.840870 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355729f-36a0-4d8a-a686-30af8bfd7a84 admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:14:51.938099 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 545/1118] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Apr 29 20:14:51 2022] PUT /identity/v3/projects/dd9e05e8defb49b0b27722f93db09942/users/c3ec09b16e584483bbca3fe678ba5544/roles/a2a640f930c44b2fa40f432179d7faa4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:14:51.949370 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b4f4e-0db4-40ea-8d03-649f93a4aec8 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:14:51.949659 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b4f4e-0db4-40ea-8d03-649f93a4aec8 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:14:51.949937 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b4f4e-0db4-40ea-8d03-649f93a4aec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:14:51.975568 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-6c1b4f4e-0db4-40ea-8d03-649f93a4aec8 None None] MFA Rules not processed for user `c3ec09b16e584483bbca3fe678ba5544`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:14:51.977266 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-6c1b4f4e-0db4-40ea-8d03-649f93a4aec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:14:52.037315 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 574/1119] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:14:51 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:14:52.049056 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355729f-36a0-4d8a-a686-30af8bfd7a84 admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:14:52.113033 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355729f-36a0-4d8a-a686-30af8bfd7a84 admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:14:52.118548 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a11cb0-dc65-49dd-bae4-7f0ba5bc7478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:14:52.119179 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11cb0-dc65-49dd-bae4-7f0ba5bc7478 service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:14:52.119463 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11cb0-dc65-49dd-bae4-7f0ba5bc7478 service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:14:52.119731 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11cb0-dc65-49dd-bae4-7f0ba5bc7478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:14:52.127377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a11cb0-dc65-49dd-bae4-7f0ba5bc7478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:14:52.132234 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a11cb0-dc65-49dd-bae4-7f0ba5bc7478 service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:14:52.138096 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 546/1120] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:14:52 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 20:14:52.200464 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73219834-942f-4144-8c8d-876f3900972f None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:14:52.200745 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73219834-942f-4144-8c8d-876f3900972f None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:14:52.201012 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73219834-942f-4144-8c8d-876f3900972f None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:14:52.202268 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 575/1121] 10.222.0.58 () {52 vars in 829 bytes} [Fri Apr 29 20:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:14:52.205838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a11cb0-dc65-49dd-bae4-7f0ba5bc7478 service nova] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:14:52.264166 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a11cb0-dc65-49dd-bae4-7f0ba5bc7478 service nova] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:14:52.268682 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61630d-f706-4b33-9699-c6963956f5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:14:52.269540 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61630d-f706-4b33-9699-c6963956f5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:14:52.269819 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61630d-f706-4b33-9699-c6963956f5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:14:52.270088 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61630d-f706-4b33-9699-c6963956f5e3 admin admin] PATH_INFO: `/v3/users/c3ec09b16e584483bbca3fe678ba5544` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:14:52.271259 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61630d-f706-4b33-9699-c6963956f5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3ec09b16e584483bbca3fe678ba5544)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:14:52.272291 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: WARNING py.warnings [None req-5f61630d-f706-4b33-9699-c6963956f5e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 20:14:52.272291 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: warnings.warn(msg) Apr 29 20:14:52.272291 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: Apr 29 20:14:52.274028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61630d-f706-4b33-9699-c6963956f5e3 admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:14:52.468147 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-5f61630d-f706-4b33-9699-c6963956f5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3ec09b16e584483bbca3fe678ba5544'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:14:52.547199 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-5f61630d-f706-4b33-9699-c6963956f5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3ec09b16e584483bbca3fe678ba5544'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:14:52.564164 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-5f61630d-f706-4b33-9699-c6963956f5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3ec09b16e584483bbca3fe678ba5544'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:14:52.576381 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-5f61630d-f706-4b33-9699-c6963956f5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3ec09b16e584483bbca3fe678ba5544'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:14:52.577120 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-5f61630d-f706-4b33-9699-c6963956f5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3ec09b16e584483bbca3fe678ba5544'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:14:52.583027 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 547/1122] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Apr 29 20:14:52 2022] DELETE /identity/v3/users/c3ec09b16e584483bbca3fe678ba5544 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:14:52.587944 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38599e-88c0-46ff-a0cf-6eeb6945e991 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:14:52.591584 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38599e-88c0-46ff-a0cf-6eeb6945e991 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:14:52.591584 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38599e-88c0-46ff-a0cf-6eeb6945e991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:14:52.605951 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-fe38599e-88c0-46ff-a0cf-6eeb6945e991 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:14:52.607135 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-fe38599e-88c0-46ff-a0cf-6eeb6945e991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:14:52.663484 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 576/1123] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:14:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:14:52.673575 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61630d-f706-4b33-9699-c6963956f5e3 admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:14:52.674998 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-5f61630d-f706-4b33-9699-c6963956f5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:14:52.751289 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61630d-f706-4b33-9699-c6963956f5e3 admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:14:52.754713 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce5504-3669-424c-8fe1-35d8cf3f62c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:14:52.755353 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce5504-3669-424c-8fe1-35d8cf3f62c2 service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:14:52.755629 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce5504-3669-424c-8fe1-35d8cf3f62c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:14:52.755896 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce5504-3669-424c-8fe1-35d8cf3f62c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:14:52.764936 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce5504-3669-424c-8fe1-35d8cf3f62c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:14:52.766343 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce5504-3669-424c-8fe1-35d8cf3f62c2 service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:14:52.775950 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 548/1124] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:14:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:14:53.216824 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38599e-88c0-46ff-a0cf-6eeb6945e991 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:14:53.218259 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-fe38599e-88c0-46ff-a0cf-6eeb6945e991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:14:53.230695 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38599e-88c0-46ff-a0cf-6eeb6945e991 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:14:53.235250 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:14:53.241779 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:14:53.244892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:14:53.244892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce admin admin] PATH_INFO: `/v3/projects/dd9e05e8defb49b0b27722f93db09942` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:14:53.244892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd9e05e8defb49b0b27722f93db09942)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:14:53.245369 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: WARNING py.warnings [None req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 20:14:53.245369 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: warnings.warn(msg) Apr 29 20:14:53.245369 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: Apr 29 20:14:53.246568 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:14:53.381862 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd9e05e8defb49b0b27722f93db09942', 'request_id': 'req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce'} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:14:53.394714 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd9e05e8defb49b0b27722f93db09942', 'request_id': 'req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce'} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:14:53.400445 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd9e05e8defb49b0b27722f93db09942', 'request_id': 'req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce'} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:14:53.570427 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce admin admin] The token cache is being invalidate because project dd9e05e8defb49b0b27722f93db09942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 20:14:53.570738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:14:53.571345 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-f308ae8f-c6c0-4b8f-b8ef-0a4bdad824ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:14:53.573080 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 577/1125] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Apr 29 20:14:53 2022] DELETE /identity/v3/projects/dd9e05e8defb49b0b27722f93db09942 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:16:15.873095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393d48c-328a-4423-8c93-f414ef58b9ea None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:15.873714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393d48c-328a-4423-8c93-f414ef58b9ea None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:15.873714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393d48c-328a-4423-8c93-f414ef58b9ea None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:15.875047 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 549/1126] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 20:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:16:15.879920 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef00423-6e63-4149-a3cf-7efa91dbda16 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:15.880384 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef00423-6e63-4149-a3cf-7efa91dbda16 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:15.880488 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef00423-6e63-4149-a3cf-7efa91dbda16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:15.897860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-cef00423-6e63-4149-a3cf-7efa91dbda16 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:16:15.899069 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-cef00423-6e63-4149-a3cf-7efa91dbda16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:16:15.956487 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 578/1127] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 20:16:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:16:16.112455 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393d48c-328a-4423-8c93-f414ef58b9ea None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:16:16.114121 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-0393d48c-328a-4423-8c93-f414ef58b9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:16:16.180646 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393d48c-328a-4423-8c93-f414ef58b9ea None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:16:16.185494 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d730bb-0a62-40e5-8e8a-b11dd17945ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:16:16.186132 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d730bb-0a62-40e5-8e8a-b11dd17945ff service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:16.186414 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d730bb-0a62-40e5-8e8a-b11dd17945ff service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:16.186695 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d730bb-0a62-40e5-8e8a-b11dd17945ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:16.194843 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d730bb-0a62-40e5-8e8a-b11dd17945ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:16:16.196450 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d730bb-0a62-40e5-8e8a-b11dd17945ff service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:16:16.205990 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 550/1128] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:16:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:16:17.482617 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600daf10-74fe-4909-a1af-a6a554ac581e None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:17.483191 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600daf10-74fe-4909-a1af-a6a554ac581e None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:17.483191 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600daf10-74fe-4909-a1af-a6a554ac581e None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:17.485185 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 579/1129] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 20:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:16:17.490129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da130f6-9a7c-4215-aaa3-50c724151bad None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:17.490549 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da130f6-9a7c-4215-aaa3-50c724151bad None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:17.490685 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da130f6-9a7c-4215-aaa3-50c724151bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:17.508174 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-2da130f6-9a7c-4215-aaa3-50c724151bad None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:16:17.509382 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-2da130f6-9a7c-4215-aaa3-50c724151bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:16:17.517148 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 551/1130] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 20:16:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:16:17.670569 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600daf10-74fe-4909-a1af-a6a554ac581e None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:16:17.684376 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600daf10-74fe-4909-a1af-a6a554ac581e None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:16:17.689264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e23b23-45e7-47a3-8620-5cfc25acbf39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:16:17.689895 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e23b23-45e7-47a3-8620-5cfc25acbf39 service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:17.690172 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e23b23-45e7-47a3-8620-5cfc25acbf39 service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:17.690451 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e23b23-45e7-47a3-8620-5cfc25acbf39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:17.698327 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e23b23-45e7-47a3-8620-5cfc25acbf39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:16:17.699895 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e23b23-45e7-47a3-8620-5cfc25acbf39 service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:16:17.709513 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 580/1131] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:16:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:16:21.755587 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc78bb-90ed-4487-9d6e-d97a813daca2 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:21.756224 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc78bb-90ed-4487-9d6e-d97a813daca2 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:21.756224 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc78bb-90ed-4487-9d6e-d97a813daca2 None None] PATH_INFO: `/v3` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:21.757472 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 552/1132] 10.222.0.16 () {54 vars in 925 bytes} [Fri Apr 29 20:16:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 29 20:16:21.763772 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38079120-0211-4d3e-ad6a-e8b7794a0cb7 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:21.764251 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38079120-0211-4d3e-ad6a-e8b7794a0cb7 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:21.764356 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38079120-0211-4d3e-ad6a-e8b7794a0cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:21.793293 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-38079120-0211-4d3e-ad6a-e8b7794a0cb7 None None] MFA Rules not processed for user `1d4caa8120a44bc79044e1459759ce4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:16:21.794459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-38079120-0211-4d3e-ad6a-e8b7794a0cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:16:21.852904 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 581/1133] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Apr 29 20:16:21 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:16:26.234799 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc2948-eb32-4c61-af36-2e9481b04423 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:26.235409 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc2948-eb32-4c61-af36-2e9481b04423 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:26.235409 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc2948-eb32-4c61-af36-2e9481b04423 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:26.236708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 553/1134] 10.222.0.58 () {54 vars in 960 bytes} [Fri Apr 29 20:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:16:26.241658 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f587ea9-337b-433d-94a9-36b7aa27b4a8 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:26.242048 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f587ea9-337b-433d-94a9-36b7aa27b4a8 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:26.242211 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f587ea9-337b-433d-94a9-36b7aa27b4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:26.259649 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-5f587ea9-337b-433d-94a9-36b7aa27b4a8 None None] MFA Rules not processed for user `1d4caa8120a44bc79044e1459759ce4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:16:26.260872 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-5f587ea9-337b-433d-94a9-36b7aa27b4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:16:26.269907 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 582/1135] 10.222.0.58 () {58 vars in 1057 bytes} [Fri Apr 29 20:16:26 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:16:26.277224 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc2948-eb32-4c61-af36-2e9481b04423 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:16:26.290665 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc2948-eb32-4c61-af36-2e9481b04423 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:16:26.295390 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fcffe-2c8b-4d11-8817-e7cb24d9e535 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4caa8120a44bc79044e1459759ce4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:16:26.296061 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fcffe-2c8b-4d11-8817-e7cb24d9e535 service placement] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:26.296344 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fcffe-2c8b-4d11-8817-e7cb24d9e535 service placement] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:26.296615 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fcffe-2c8b-4d11-8817-e7cb24d9e535 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:26.304565 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fcffe-2c8b-4d11-8817-e7cb24d9e535 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:16:26.306114 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fcffe-2c8b-4d11-8817-e7cb24d9e535 service placement] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:16:26.315357 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 554/1136] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:16:26 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 20:16:29.401096 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ceee-466e-485f-8f96-4b350694a4a2 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:29.401669 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ceee-466e-485f-8f96-4b350694a4a2 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:29.401669 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ceee-466e-485f-8f96-4b350694a4a2 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:29.403079 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 583/1137] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 20:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:16:29.408116 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276394c3-0522-455c-9d72-754ebdfb1577 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:29.408498 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276394c3-0522-455c-9d72-754ebdfb1577 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:29.408663 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276394c3-0522-455c-9d72-754ebdfb1577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:29.425892 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-276394c3-0522-455c-9d72-754ebdfb1577 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:16:29.427074 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-276394c3-0522-455c-9d72-754ebdfb1577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:16:29.434694 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 555/1138] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 20:16:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:16:29.596884 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9ceee-466e-485f-8f96-4b350694a4a2 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:16:29.609823 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9ceee-466e-485f-8f96-4b350694a4a2 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:16:29.614651 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e4450-d45f-431e-8bf1-2f9c804d79d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:16:29.615271 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e4450-d45f-431e-8bf1-2f9c804d79d3 service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:29.615544 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e4450-d45f-431e-8bf1-2f9c804d79d3 service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:29.615813 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e4450-d45f-431e-8bf1-2f9c804d79d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:29.623713 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e4450-d45f-431e-8bf1-2f9c804d79d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:16:29.625877 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e4450-d45f-431e-8bf1-2f9c804d79d3 service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:16:29.635213 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 584/1139] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:16:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:16:30.907124 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983ea8f-574b-407c-946c-5d86ce6ac130 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:30.907785 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983ea8f-574b-407c-946c-5d86ce6ac130 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:30.907785 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983ea8f-574b-407c-946c-5d86ce6ac130 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:30.909086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 556/1140] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 29 20:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:16:30.913807 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea75a1-3cb5-4300-adea-5206cae67502 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:30.914235 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea75a1-3cb5-4300-adea-5206cae67502 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:30.914344 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea75a1-3cb5-4300-adea-5206cae67502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:30.932035 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-bdea75a1-3cb5-4300-adea-5206cae67502 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:16:30.933196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-bdea75a1-3cb5-4300-adea-5206cae67502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:16:30.940905 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 585/1141] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 29 20:16:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:16:31.095242 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983ea8f-574b-407c-946c-5d86ce6ac130 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:16:31.108269 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983ea8f-574b-407c-946c-5d86ce6ac130 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:16:31.113733 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cf2ba-4f5a-4df0-9cfd-900194361638 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:16:31.114353 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cf2ba-4f5a-4df0-9cfd-900194361638 service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:31.114639 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cf2ba-4f5a-4df0-9cfd-900194361638 service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:31.114911 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cf2ba-4f5a-4df0-9cfd-900194361638 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:31.122756 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cf2ba-4f5a-4df0-9cfd-900194361638 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:16:31.124430 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0cf2ba-4f5a-4df0-9cfd-900194361638 service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:16:31.133591 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 557/1142] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:16:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:16:35.388465 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d9730-c4e2-44f1-83fa-d68623160ec6 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:35.388984 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d9730-c4e2-44f1-83fa-d68623160ec6 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:35.388984 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d9730-c4e2-44f1-83fa-d68623160ec6 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:35.390337 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 586/1143] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 20:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:16:35.395374 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940b2b-f09b-4caa-bd38-c9530dc96190 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:35.395809 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940b2b-f09b-4caa-bd38-c9530dc96190 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:35.395954 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940b2b-f09b-4caa-bd38-c9530dc96190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:35.413944 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-fc940b2b-f09b-4caa-bd38-c9530dc96190 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:16:35.415129 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-fc940b2b-f09b-4caa-bd38-c9530dc96190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:16:35.423488 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 558/1144] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 20:16:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:16:35.460034 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d9730-c4e2-44f1-83fa-d68623160ec6 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:16:35.461991 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-056d9730-c4e2-44f1-83fa-d68623160ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:16:35.517892 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d9730-c4e2-44f1-83fa-d68623160ec6 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:16:35.521389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6694aac-12b9-4d91-8a4e-477cbe58e60a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:16:35.522029 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6694aac-12b9-4d91-8a4e-477cbe58e60a service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:35.522313 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6694aac-12b9-4d91-8a4e-477cbe58e60a service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:35.522589 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6694aac-12b9-4d91-8a4e-477cbe58e60a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:35.531756 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6694aac-12b9-4d91-8a4e-477cbe58e60a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:16:35.533212 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6694aac-12b9-4d91-8a4e-477cbe58e60a service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:16:35.542315 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 587/1145] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:16:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:16:37.812866 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9d8d2-953c-45da-a450-eb07506ccbea None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:37.813408 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9d8d2-953c-45da-a450-eb07506ccbea None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:37.813408 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9d8d2-953c-45da-a450-eb07506ccbea None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:37.814729 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 559/1146] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 20:16:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:16:37.819885 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcace126-685e-4304-a437-37cea1b07155 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:37.820345 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcace126-685e-4304-a437-37cea1b07155 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:37.820462 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcace126-685e-4304-a437-37cea1b07155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:37.838928 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-bcace126-685e-4304-a437-37cea1b07155 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:16:37.840143 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-bcace126-685e-4304-a437-37cea1b07155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:16:37.847810 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 588/1147] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 20:16:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:16:37.883385 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9d8d2-953c-45da-a450-eb07506ccbea None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:16:37.894316 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9d8d2-953c-45da-a450-eb07506ccbea None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:16:37.897801 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c50db-27ed-4c68-abc0-aefcc149c4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:16:37.898428 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c50db-27ed-4c68-abc0-aefcc149c4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:37.898707 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c50db-27ed-4c68-abc0-aefcc149c4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:37.898979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c50db-27ed-4c68-abc0-aefcc149c4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:37.907664 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c50db-27ed-4c68-abc0-aefcc149c4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:16:37.909146 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c50db-27ed-4c68-abc0-aefcc149c4a1 service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:16:37.918222 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 560/1148] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:16:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:16:41.717406 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1ca1a-dc74-4f50-92da-de88ff869fe8 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:41.717921 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1ca1a-dc74-4f50-92da-de88ff869fe8 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:41.717921 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1ca1a-dc74-4f50-92da-de88ff869fe8 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:41.719856 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 589/1149] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 20:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:16:41.725173 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f8fea-0f16-4b2a-bea7-6945c334d522 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:41.725607 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f8fea-0f16-4b2a-bea7-6945c334d522 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:41.725710 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f8fea-0f16-4b2a-bea7-6945c334d522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:41.743336 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-c44f8fea-0f16-4b2a-bea7-6945c334d522 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:16:41.744560 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-c44f8fea-0f16-4b2a-bea7-6945c334d522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:16:41.752281 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 561/1150] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 20:16:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:16:42.022986 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1ca1a-dc74-4f50-92da-de88ff869fe8 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:16:42.024642 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-f6c1ca1a-dc74-4f50-92da-de88ff869fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:16:42.080622 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1ca1a-dc74-4f50-92da-de88ff869fe8 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:16:42.084333 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26b14f-cde2-4fb2-901e-2b5c77b765c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc441c13aa14d6ab0446965f0d91aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:16:42.084974 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26b14f-cde2-4fb2-901e-2b5c77b765c4 service cinder] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:42.085258 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26b14f-cde2-4fb2-901e-2b5c77b765c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:42.085538 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26b14f-cde2-4fb2-901e-2b5c77b765c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:42.094551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26b14f-cde2-4fb2-901e-2b5c77b765c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:16:42.095993 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26b14f-cde2-4fb2-901e-2b5c77b765c4 service cinder] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:16:42.105145 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 590/1151] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:16:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:16:44.423709 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3926638-b989-431b-b364-df89574b419e None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:44.424302 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3926638-b989-431b-b364-df89574b419e None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:44.424302 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3926638-b989-431b-b364-df89574b419e None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:44.425558 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 562/1152] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 29 20:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:16:44.430599 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601e9c8-3f35-44f2-af41-e3d97a90eb23 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:44.431019 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601e9c8-3f35-44f2-af41-e3d97a90eb23 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:44.434485 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601e9c8-3f35-44f2-af41-e3d97a90eb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:44.449093 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-b601e9c8-3f35-44f2-af41-e3d97a90eb23 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:16:44.450267 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-b601e9c8-3f35-44f2-af41-e3d97a90eb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:16:44.458161 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 591/1153] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 29 20:16:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:16:44.747689 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d85925-febf-4af4-9a9c-abd06f37656d None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:44.747996 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d85925-febf-4af4-9a9c-abd06f37656d None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:44.748273 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d85925-febf-4af4-9a9c-abd06f37656d None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:44.749637 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 563/1154] 10.222.0.58 () {54 vars in 962 bytes} [Fri Apr 29 20:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:16:44.754647 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3262f6-70f9-4606-a94c-de76be8ab677 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:44.754939 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3262f6-70f9-4606-a94c-de76be8ab677 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:44.755220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3262f6-70f9-4606-a94c-de76be8ab677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:44.773007 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-9e3262f6-70f9-4606-a94c-de76be8ab677 None None] MFA Rules not processed for user `6dc441c13aa14d6ab0446965f0d91aca`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:16:44.774180 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-9e3262f6-70f9-4606-a94c-de76be8ab677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:16:44.780535 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 592/1155] 10.222.0.58 () {58 vars in 1059 bytes} [Fri Apr 29 20:16:44 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:16:44.788124 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d85925-febf-4af4-9a9c-abd06f37656d None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:16:44.798287 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d85925-febf-4af4-9a9c-abd06f37656d None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:16:44.801717 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d4aab-b0f1-4d32-b303-db4826e10f6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc441c13aa14d6ab0446965f0d91aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:16:44.802334 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d4aab-b0f1-4d32-b303-db4826e10f6a service cinder] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:16:44.802609 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d4aab-b0f1-4d32-b303-db4826e10f6a service cinder] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:16:44.802879 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d4aab-b0f1-4d32-b303-db4826e10f6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:16:44.811400 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d4aab-b0f1-4d32-b303-db4826e10f6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:16:44.812849 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d4aab-b0f1-4d32-b303-db4826e10f6a service cinder] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:16:44.821991 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 564/1156] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:16:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 20:18:03.632290 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd88659-6ac9-42c0-ba9a-89ffc2c2fdc6 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:03.632906 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd88659-6ac9-42c0-ba9a-89ffc2c2fdc6 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:03.632906 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd88659-6ac9-42c0-ba9a-89ffc2c2fdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:03.637978 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe5985-ecf0-4866-8214-ddecaba44837 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:03.638423 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe5985-ecf0-4866-8214-ddecaba44837 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:03.638538 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe5985-ecf0-4866-8214-ddecaba44837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:03.651046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-3fd88659-6ac9-42c0-ba9a-89ffc2c2fdc6 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:03.652264 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-3fd88659-6ac9-42c0-ba9a-89ffc2c2fdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:03.655950 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-65fe5985-ecf0-4866-8214-ddecaba44837 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:03.657154 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-65fe5985-ecf0-4866-8214-ddecaba44837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:03.660686 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 593/1157] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:18:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:18:03.665483 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 565/1158] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:18:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:18:03.669510 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2680ef2-dd56-4227-9a30-ea3068a4fb24 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:03.669796 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2680ef2-dd56-4227-9a30-ea3068a4fb24 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:03.670069 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2680ef2-dd56-4227-9a30-ea3068a4fb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:03.674277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7730a-3625-410d-8c0e-cdb421a4bac4 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:03.674601 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7730a-3625-410d-8c0e-cdb421a4bac4 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:03.674879 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7730a-3625-410d-8c0e-cdb421a4bac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:03.687882 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-b2680ef2-dd56-4227-9a30-ea3068a4fb24 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:03.689100 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-b2680ef2-dd56-4227-9a30-ea3068a4fb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:03.694039 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-58c7730a-3625-410d-8c0e-cdb421a4bac4 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:03.695201 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-58c7730a-3625-410d-8c0e-cdb421a4bac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:03.697401 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 594/1159] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:18:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:18:03.701845 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2680ef2-dd56-4227-9a30-ea3068a4fb24 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:03.703362 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 566/1160] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:18:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:18:03.708459 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7730a-3625-410d-8c0e-cdb421a4bac4 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:03.714152 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2680ef2-dd56-4227-9a30-ea3068a4fb24 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:03.717440 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7730a-3625-410d-8c0e-cdb421a4bac4 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:03.718771 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbe0d6-2a00-4a02-9353-5a89e4bf346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:03.719418 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe0d6-2a00-4a02-9353-5a89e4bf346c admin admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:03.719702 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe0d6-2a00-4a02-9353-5a89e4bf346c admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:03.719990 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe0d6-2a00-4a02-9353-5a89e4bf346c admin admin] PATH_INFO: `/v3/domains` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:03.720717 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbe0d6-2a00-4a02-9353-5a89e4bf346c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:18:03.721027 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbe0d6-2a00-4a02-9353-5a89e4bf346c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:03.722165 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e8f69-761e-46cd-b07a-69253346a7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:03.722658 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbe0d6-2a00-4a02-9353-5a89e4bf346c admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:03.722799 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e8f69-761e-46cd-b07a-69253346a7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:03.723079 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e8f69-761e-46cd-b07a-69253346a7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:03.723347 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e8f69-761e-46cd-b07a-69253346a7c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:03.724094 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e8f69-761e-46cd-b07a-69253346a7c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87060) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 29 20:18:03.724392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e8f69-761e-46cd-b07a-69253346a7c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:03.725389 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: WARNING py.warnings [None req-f98e8f69-761e-46cd-b07a-69253346a7c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 29 20:18:03.725389 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: warnings.warn(msg) Apr 29 20:18:03.725389 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: Apr 29 20:18:03.726277 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e8f69-761e-46cd-b07a-69253346a7c7 admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:03.733753 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 595/1161] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Apr 29 20:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:18:03.737538 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 567/1162] 10.222.0.58 () {58 vars in 1152 bytes} [Fri Apr 29 20:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 29 20:18:03.741580 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbe0d6-2a00-4a02-9353-5a89e4bf346c admin admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:03.745117 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e8f69-761e-46cd-b07a-69253346a7c7 admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:03.751013 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbe0d6-2a00-4a02-9353-5a89e4bf346c admin admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:03.755150 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e8f69-761e-46cd-b07a-69253346a7c7 admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:03.756099 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c480673-547c-48cb-9359-3f8cf6351704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:03.756739 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c480673-547c-48cb-9359-3f8cf6351704 admin admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:03.757020 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c480673-547c-48cb-9359-3f8cf6351704 admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:03.757295 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c480673-547c-48cb-9359-3f8cf6351704 admin admin] PATH_INFO: `/v3/projects` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:03.757980 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c480673-547c-48cb-9359-3f8cf6351704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:03.758981 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: WARNING py.warnings [None req-4c480673-547c-48cb-9359-3f8cf6351704 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 20:18:03.758981 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: warnings.warn(msg) Apr 29 20:18:03.758981 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: Apr 29 20:18:03.759736 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ae5d3-d6d6-414e-854d-a8c797f8bb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:03.760196 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c480673-547c-48cb-9359-3f8cf6351704 admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:03.760398 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae5d3-d6d6-414e-854d-a8c797f8bb52 admin admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:03.760680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae5d3-d6d6-414e-854d-a8c797f8bb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:03.760955 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae5d3-d6d6-414e-854d-a8c797f8bb52 admin admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:03.761690 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ae5d3-d6d6-414e-854d-a8c797f8bb52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:03.763562 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ae5d3-d6d6-414e-854d-a8c797f8bb52 admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:03.856400 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 596/1163] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Apr 29 20:18:03 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 20:18:03.859459 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c480673-547c-48cb-9359-3f8cf6351704 admin admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:03.863262 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 568/1164] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Apr 29 20:18:03 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 20:18:03.867441 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ae5d3-d6d6-414e-854d-a8c797f8bb52 admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:03.923575 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c480673-547c-48cb-9359-3f8cf6351704 admin admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:03.926071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaf147-b142-49eb-955d-8b43346cb92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:03.926708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaf147-b142-49eb-955d-8b43346cb92d admin admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:03.926985 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaf147-b142-49eb-955d-8b43346cb92d admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:03.927256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaf147-b142-49eb-955d-8b43346cb92d admin admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:03.927992 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecaf147-b142-49eb-955d-8b43346cb92d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:03.929721 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ae5d3-d6d6-414e-854d-a8c797f8bb52 admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:03.929883 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecaf147-b142-49eb-955d-8b43346cb92d admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:03.936627 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89f225-2cb0-4bbb-9dd0-a802b475e891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:03.937291 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89f225-2cb0-4bbb-9dd0-a802b475e891 admin admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:03.937572 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89f225-2cb0-4bbb-9dd0-a802b475e891 admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:03.937830 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89f225-2cb0-4bbb-9dd0-a802b475e891 admin admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:03.938538 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89f225-2cb0-4bbb-9dd0-a802b475e891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:03.939536 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: WARNING py.warnings [None req-2f89f225-2cb0-4bbb-9dd0-a802b475e891 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 20:18:03.939536 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: warnings.warn(msg) Apr 29 20:18:03.939536 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: Apr 29 20:18:03.941307 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89f225-2cb0-4bbb-9dd0-a802b475e891 admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:04.033454 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 597/1165] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Apr 29 20:18:03 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 20:18:04.037582 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaf147-b142-49eb-955d-8b43346cb92d admin admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:04.046984 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaf147-b142-49eb-955d-8b43346cb92d admin admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:04.052194 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b8bde-2252-41ca-85b5-dbf0916e1cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:04.052824 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b8bde-2252-41ca-85b5-dbf0916e1cfc admin admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:04.053105 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b8bde-2252-41ca-85b5-dbf0916e1cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:04.053379 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b8bde-2252-41ca-85b5-dbf0916e1cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:04.054116 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b8bde-2252-41ca-85b5-dbf0916e1cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:04.055807 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b8bde-2252-41ca-85b5-dbf0916e1cfc admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:04.063178 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 569/1166] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Apr 29 20:18:03 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 20:18:04.066990 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 598/1167] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Apr 29 20:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 20:18:04.069835 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89f225-2cb0-4bbb-9dd0-a802b475e891 admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:04.071313 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b8bde-2252-41ca-85b5-dbf0916e1cfc admin admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:04.079524 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89f225-2cb0-4bbb-9dd0-a802b475e891 admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:04.080648 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b8bde-2252-41ca-85b5-dbf0916e1cfc admin admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:04.084067 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45e573-5bdd-48de-a0f0-c06c9f4fe653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:04.084971 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45e573-5bdd-48de-a0f0-c06c9f4fe653 admin admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:04.085249 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45e573-5bdd-48de-a0f0-c06c9f4fe653 admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:04.085516 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45e573-5bdd-48de-a0f0-c06c9f4fe653 admin admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:04.085654 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66068a78-7e1f-402a-87de-66a3787c0240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:04.086250 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45e573-5bdd-48de-a0f0-c06c9f4fe653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:04.086360 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66068a78-7e1f-402a-87de-66a3787c0240 admin admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:04.086539 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66068a78-7e1f-402a-87de-66a3787c0240 admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:04.086806 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66068a78-7e1f-402a-87de-66a3787c0240 admin admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:04.087502 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66068a78-7e1f-402a-87de-66a3787c0240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:04.087826 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45e573-5bdd-48de-a0f0-c06c9f4fe653 admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:04.089193 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66068a78-7e1f-402a-87de-66a3787c0240 admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:04.097423 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 570/1168] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Apr 29 20:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 20:18:04.101378 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 599/1169] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Apr 29 20:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 20:18:04.103953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45e573-5bdd-48de-a0f0-c06c9f4fe653 admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:04.104533 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66068a78-7e1f-402a-87de-66a3787c0240 admin admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:04.113776 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45e573-5bdd-48de-a0f0-c06c9f4fe653 admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:04.114389 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66068a78-7e1f-402a-87de-66a3787c0240 admin admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:04.118309 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b88b0-ec12-4dbf-916b-f971e713728d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:04.118947 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b88b0-ec12-4dbf-916b-f971e713728d admin admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:04.119226 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b88b0-ec12-4dbf-916b-f971e713728d admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:04.119344 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6463101-d640-4805-8711-abccb5f4e3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:04.119522 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b88b0-ec12-4dbf-916b-f971e713728d admin admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:04.120112 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6463101-d640-4805-8711-abccb5f4e3bf admin admin] REQUEST_METHOD: `PUT` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:04.120262 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b88b0-ec12-4dbf-916b-f971e713728d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:04.120391 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6463101-d640-4805-8711-abccb5f4e3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:04.120661 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6463101-d640-4805-8711-abccb5f4e3bf admin admin] PATH_INFO: `/v3/projects/751ecce457bd4fa2872d2f9463d48a16/users/0cc61b0e25924d37b2f6e6f225f423d3/roles/a2a640f930c44b2fa40f432179d7faa4` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:04.121877 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b88b0-ec12-4dbf-916b-f971e713728d admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:04.133336 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 571/1170] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Apr 29 20:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 20:18:04.136023 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6463101-d640-4805-8711-abccb5f4e3bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=751ecce457bd4fa2872d2f9463d48a16, user_id=0cc61b0e25924d37b2f6e6f225f423d3, role_id=a2a640f930c44b2fa40f432179d7faa4)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:04.136575 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: WARNING py.warnings [None req-d6463101-d640-4805-8711-abccb5f4e3bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 29 20:18:04.136575 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: warnings.warn(msg) Apr 29 20:18:04.136575 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: Apr 29 20:18:04.138486 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6463101-d640-4805-8711-abccb5f4e3bf admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:04.138807 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b88b0-ec12-4dbf-916b-f971e713728d admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:04.148188 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b88b0-ec12-4dbf-916b-f971e713728d admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:04.152772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49251424-ee63-4400-b896-e85f0210dc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:04.158767 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49251424-ee63-4400-b896-e85f0210dc2f admin admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:04.158767 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49251424-ee63-4400-b896-e85f0210dc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:04.158767 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49251424-ee63-4400-b896-e85f0210dc2f admin admin] PATH_INFO: `/v3/projects/d326466543374fae8e7be5f60de02ed5/users/982fa964e7b045f790055499f1787dfd/roles/a2a640f930c44b2fa40f432179d7faa4` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:04.167806 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49251424-ee63-4400-b896-e85f0210dc2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d326466543374fae8e7be5f60de02ed5, user_id=982fa964e7b045f790055499f1787dfd, role_id=a2a640f930c44b2fa40f432179d7faa4)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:04.170500 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49251424-ee63-4400-b896-e85f0210dc2f admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:04.227835 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 600/1171] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Apr 29 20:18:04 2022] PUT /identity/v3/projects/751ecce457bd4fa2872d2f9463d48a16/users/0cc61b0e25924d37b2f6e6f225f423d3/roles/a2a640f930c44b2fa40f432179d7faa4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 20:18:04.232932 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f67f2-6e5f-47cd-b188-93289f9a1b78 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:04.233217 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f67f2-6e5f-47cd-b188-93289f9a1b78 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:04.233493 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f67f2-6e5f-47cd-b188-93289f9a1b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:04.250230 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-706f67f2-6e5f-47cd-b188-93289f9a1b78 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:04.251411 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-706f67f2-6e5f-47cd-b188-93289f9a1b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:04.272084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 572/1172] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Apr 29 20:18:04 2022] PUT /identity/v3/projects/d326466543374fae8e7be5f60de02ed5/users/982fa964e7b045f790055499f1787dfd/roles/a2a640f930c44b2fa40f432179d7faa4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:18:04.277171 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180068c8-8157-4c15-adc1-d98441dafc16 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:04.277457 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180068c8-8157-4c15-adc1-d98441dafc16 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:04.277738 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180068c8-8157-4c15-adc1-d98441dafc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:04.294276 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-180068c8-8157-4c15-adc1-d98441dafc16 None None] MFA Rules not processed for user `60cf68d8163c4e1192fe62342bc80660`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:04.295496 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-180068c8-8157-4c15-adc1-d98441dafc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:04.308853 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 601/1173] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:18:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:18:04.320106 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f67f2-6e5f-47cd-b188-93289f9a1b78 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:04.354213 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 573/1174] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:18:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:18:04.364772 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180068c8-8157-4c15-adc1-d98441dafc16 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:04.366099 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-180068c8-8157-4c15-adc1-d98441dafc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:04.381639 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f67f2-6e5f-47cd-b188-93289f9a1b78 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:04.419326 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180068c8-8157-4c15-adc1-d98441dafc16 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:04.423071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090870f-5117-481b-a7e9-780d52ef25cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:04.423714 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090870f-5117-481b-a7e9-780d52ef25cc service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:04.424052 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090870f-5117-481b-a7e9-780d52ef25cc service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:04.424335 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090870f-5117-481b-a7e9-780d52ef25cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:04.427744 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af00875-b314-47a5-a61d-3eb7ac09bc92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:04.428415 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af00875-b314-47a5-a61d-3eb7ac09bc92 service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:04.428697 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af00875-b314-47a5-a61d-3eb7ac09bc92 service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:04.428972 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af00875-b314-47a5-a61d-3eb7ac09bc92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:04.433890 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090870f-5117-481b-a7e9-780d52ef25cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:04.435353 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090870f-5117-481b-a7e9-780d52ef25cc service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:04.437978 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af00875-b314-47a5-a61d-3eb7ac09bc92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:04.439430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af00875-b314-47a5-a61d-3eb7ac09bc92 service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:04.445105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 574/1175] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:18:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 20:18:04.449346 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 602/1176] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:18:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 20:18:11.685707 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbfd54-a1fc-43b1-a6d5-48310e07956d None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:11.686260 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbfd54-a1fc-43b1-a6d5-48310e07956d None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:11.686260 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbfd54-a1fc-43b1-a6d5-48310e07956d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:11.739423 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-fdbbfd54-a1fc-43b1-a6d5-48310e07956d None None] MFA Rules not processed for user `982fa964e7b045f790055499f1787dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:11.740632 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-fdbbfd54-a1fc-43b1-a6d5-48310e07956d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:11.757738 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bdb79-abfe-4871-baaf-49a9d5c65605 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:11.758286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bdb79-abfe-4871-baaf-49a9d5c65605 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:11.758286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bdb79-abfe-4871-baaf-49a9d5c65605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:11.807416 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-f44bdb79-abfe-4871-baaf-49a9d5c65605 None None] MFA Rules not processed for user `0cc61b0e25924d37b2f6e6f225f423d3`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:11.814742 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-f44bdb79-abfe-4871-baaf-49a9d5c65605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:11.842826 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 575/1177] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:18:11 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:18:11.847259 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbfd54-a1fc-43b1-a6d5-48310e07956d None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:11.858359 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbfd54-a1fc-43b1-a6d5-48310e07956d None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:11.865170 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68917f1b-a6be-407a-b959-4b398bbabe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:11.866614 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917f1b-a6be-407a-b959-4b398bbabe8e admin admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:11.867138 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917f1b-a6be-407a-b959-4b398bbabe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:11.867327 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917f1b-a6be-407a-b959-4b398bbabe8e admin admin] PATH_INFO: `/v3/projects` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:11.868200 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68917f1b-a6be-407a-b959-4b398bbabe8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:11.872564 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68917f1b-a6be-407a-b959-4b398bbabe8e admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:11.911123 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 603/1178] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:18:11 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:18:11.916358 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bdb79-abfe-4871-baaf-49a9d5c65605 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:11.930192 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bdb79-abfe-4871-baaf-49a9d5c65605 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:11.934984 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ebd38-53f8-478c-9da1-4a7fd0b1e5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:11.935708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ebd38-53f8-478c-9da1-4a7fd0b1e5cd admin admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:11.939870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ebd38-53f8-478c-9da1-4a7fd0b1e5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:11.939870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ebd38-53f8-478c-9da1-4a7fd0b1e5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:11.939870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ebd38-53f8-478c-9da1-4a7fd0b1e5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:11.939870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ebd38-53f8-478c-9da1-4a7fd0b1e5cd admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:11.968087 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 576/1179] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Apr 29 20:18:11 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 20:18:11.973886 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68917f1b-a6be-407a-b959-4b398bbabe8e admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:12.035617 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 604/1180] 10.222.0.58 () {60 vars in 1152 bytes} [Fri Apr 29 20:18:11 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 20:18:12.039838 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ebd38-53f8-478c-9da1-4a7fd0b1e5cd admin admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:12.042763 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68917f1b-a6be-407a-b959-4b398bbabe8e admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:12.106725 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208031e8-19c6-4b49-b8e9-e3fa30470be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:12.107463 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208031e8-19c6-4b49-b8e9-e3fa30470be9 admin admin] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:12.107749 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208031e8-19c6-4b49-b8e9-e3fa30470be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:12.108047 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208031e8-19c6-4b49-b8e9-e3fa30470be9 admin admin] PATH_INFO: `/v3/users` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:12.108790 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208031e8-19c6-4b49-b8e9-e3fa30470be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:12.110891 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208031e8-19c6-4b49-b8e9-e3fa30470be9 admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:12.111206 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ebd38-53f8-478c-9da1-4a7fd0b1e5cd admin admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:12.116818 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f6e0b-459b-4f61-b335-3bf05032ee9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:12.117497 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6e0b-459b-4f61-b335-3bf05032ee9b admin admin] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:12.117780 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6e0b-459b-4f61-b335-3bf05032ee9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:12.118056 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6e0b-459b-4f61-b335-3bf05032ee9b admin admin] PATH_INFO: `/v3/users` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:12.119011 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f6e0b-459b-4f61-b335-3bf05032ee9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:12.122455 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f6e0b-459b-4f61-b335-3bf05032ee9b admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:12.215762 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 577/1181] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Apr 29 20:18:11 2022] POST /identity/v3/users => generated 295 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 20:18:12.219576 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208031e8-19c6-4b49-b8e9-e3fa30470be9 admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:12.230589 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208031e8-19c6-4b49-b8e9-e3fa30470be9 admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:12.235322 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e6f65-2d82-45e0-87d3-4a9d63e2b1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:12.235997 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e6f65-2d82-45e0-87d3-4a9d63e2b1bb admin admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:12.236586 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e6f65-2d82-45e0-87d3-4a9d63e2b1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:12.237522 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e6f65-2d82-45e0-87d3-4a9d63e2b1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:12.238257 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e6f65-2d82-45e0-87d3-4a9d63e2b1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:12.239873 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e6f65-2d82-45e0-87d3-4a9d63e2b1bb admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:12.246048 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 605/1182] 10.222.0.58 () {60 vars in 1143 bytes} [Fri Apr 29 20:18:12 2022] POST /identity/v3/users => generated 298 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 29 20:18:12.250139 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f6e0b-459b-4f61-b335-3bf05032ee9b admin admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:12.251021 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 578/1183] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Apr 29 20:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 20:18:12.257183 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e6f65-2d82-45e0-87d3-4a9d63e2b1bb admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:12.261661 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f6e0b-459b-4f61-b335-3bf05032ee9b admin admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:12.266796 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1dbc3-bc69-4d91-a5aa-0516e2e0885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:12.267618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1dbc3-bc69-4d91-a5aa-0516e2e0885c admin admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:12.268024 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e6f65-2d82-45e0-87d3-4a9d63e2b1bb admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:12.268276 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1dbc3-bc69-4d91-a5aa-0516e2e0885c admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:12.268663 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1dbc3-bc69-4d91-a5aa-0516e2e0885c admin admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:12.269508 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1dbc3-bc69-4d91-a5aa-0516e2e0885c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:12.271245 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1dbc3-bc69-4d91-a5aa-0516e2e0885c admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:12.273071 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fc7c3-7eea-45d9-afca-b219362b3a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:12.276068 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fc7c3-7eea-45d9-afca-b219362b3a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:12.276068 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fc7c3-7eea-45d9-afca-b219362b3a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:12.276068 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fc7c3-7eea-45d9-afca-b219362b3a1d admin admin] PATH_INFO: `/v3/projects/01ea80582407497ab01903fda3ec18a6/users/3b019ab794c348bb917fdf0dc7aea8e4/roles/5255ed3fa613448fb4c549f5bc7f20af` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:12.282708 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 606/1184] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Apr 29 20:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 20:18:12.287661 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1dbc3-bc69-4d91-a5aa-0516e2e0885c admin admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:12.290441 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fc7c3-7eea-45d9-afca-b219362b3a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ea80582407497ab01903fda3ec18a6, user_id=3b019ab794c348bb917fdf0dc7aea8e4, role_id=5255ed3fa613448fb4c549f5bc7f20af)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:12.293203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fc7c3-7eea-45d9-afca-b219362b3a1d admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:12.297938 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1dbc3-bc69-4d91-a5aa-0516e2e0885c admin admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:12.303364 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9797382-7d8b-4cd2-98e4-a6838d3006f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:12.304399 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9797382-7d8b-4cd2-98e4-a6838d3006f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:12.304854 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9797382-7d8b-4cd2-98e4-a6838d3006f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:12.305229 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9797382-7d8b-4cd2-98e4-a6838d3006f3 admin admin] PATH_INFO: `/v3/projects/36d941262045404dac060112b011799e/users/2d9985747f4f4440a34f39f5bc24e084/roles/5255ed3fa613448fb4c549f5bc7f20af` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:12.324721 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9797382-7d8b-4cd2-98e4-a6838d3006f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d941262045404dac060112b011799e, user_id=2d9985747f4f4440a34f39f5bc24e084, role_id=5255ed3fa613448fb4c549f5bc7f20af)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:12.327447 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9797382-7d8b-4cd2-98e4-a6838d3006f3 admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:12.393906 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 579/1185] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Apr 29 20:18:12 2022] PUT /identity/v3/projects/01ea80582407497ab01903fda3ec18a6/users/3b019ab794c348bb917fdf0dc7aea8e4/roles/5255ed3fa613448fb4c549f5bc7f20af => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:18:12.397707 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fc7c3-7eea-45d9-afca-b219362b3a1d admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:12.423213 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 607/1186] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Apr 29 20:18:12 2022] PUT /identity/v3/projects/36d941262045404dac060112b011799e/users/2d9985747f4f4440a34f39f5bc24e084/roles/5255ed3fa613448fb4c549f5bc7f20af => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 20:18:12.427826 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9797382-7d8b-4cd2-98e4-a6838d3006f3 admin admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:12.470293 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fc7c3-7eea-45d9-afca-b219362b3a1d admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:12.510728 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9797382-7d8b-4cd2-98e4-a6838d3006f3 admin admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:12.521252 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54053472-bc5b-40e4-8cf2-0544cbadb411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:12.523057 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54053472-bc5b-40e4-8cf2-0544cbadb411 admin admin] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:12.523564 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54053472-bc5b-40e4-8cf2-0544cbadb411 admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:12.524314 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54053472-bc5b-40e4-8cf2-0544cbadb411 admin admin] PATH_INFO: `/v3/roles` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:12.529484 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54053472-bc5b-40e4-8cf2-0544cbadb411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:12.531205 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54053472-bc5b-40e4-8cf2-0544cbadb411 admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:12.541875 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b652ce1-a82c-4621-98e1-31dc1c81f33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:12.542698 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b652ce1-a82c-4621-98e1-31dc1c81f33e admin admin] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:12.543093 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b652ce1-a82c-4621-98e1-31dc1c81f33e admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:12.543459 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b652ce1-a82c-4621-98e1-31dc1c81f33e admin admin] PATH_INFO: `/v3/roles` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:12.544363 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b652ce1-a82c-4621-98e1-31dc1c81f33e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:12.546212 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b652ce1-a82c-4621-98e1-31dc1c81f33e admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:12.554239 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 608/1187] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Apr 29 20:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 29 20:18:12.558553 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54053472-bc5b-40e4-8cf2-0544cbadb411 admin admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:12.561542 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 580/1188] 10.222.0.58 () {58 vars in 1121 bytes} [Fri Apr 29 20:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 29 20:18:12.569833 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b652ce1-a82c-4621-98e1-31dc1c81f33e admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:12.575897 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54053472-bc5b-40e4-8cf2-0544cbadb411 admin admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:12.580322 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b652ce1-a82c-4621-98e1-31dc1c81f33e admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:12.582519 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ab53f-548d-42e9-8ba6-d4af3073e8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:12.583444 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ab53f-548d-42e9-8ba6-d4af3073e8ad admin admin] REQUEST_METHOD: `PUT` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:12.583727 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ab53f-548d-42e9-8ba6-d4af3073e8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:12.584460 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ab53f-548d-42e9-8ba6-d4af3073e8ad admin admin] PATH_INFO: `/v3/projects/36d941262045404dac060112b011799e/users/2d9985747f4f4440a34f39f5bc24e084/roles/5255ed3fa613448fb4c549f5bc7f20af` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:12.586467 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ab53f-548d-42e9-8ba6-d4af3073e8ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d941262045404dac060112b011799e, user_id=2d9985747f4f4440a34f39f5bc24e084, role_id=5255ed3fa613448fb4c549f5bc7f20af)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:12.587272 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fc95c-66f5-418e-9d3a-f1d24640974b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:12.588276 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fc95c-66f5-418e-9d3a-f1d24640974b admin admin] REQUEST_METHOD: `PUT` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:12.588631 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fc95c-66f5-418e-9d3a-f1d24640974b admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:12.588994 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fc95c-66f5-418e-9d3a-f1d24640974b admin admin] PATH_INFO: `/v3/projects/01ea80582407497ab01903fda3ec18a6/users/3b019ab794c348bb917fdf0dc7aea8e4/roles/5255ed3fa613448fb4c549f5bc7f20af` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:12.589209 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ab53f-548d-42e9-8ba6-d4af3073e8ad admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:12.591938 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fc95c-66f5-418e-9d3a-f1d24640974b admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ea80582407497ab01903fda3ec18a6, user_id=3b019ab794c348bb917fdf0dc7aea8e4, role_id=5255ed3fa613448fb4c549f5bc7f20af)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:12.594407 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fc95c-66f5-418e-9d3a-f1d24640974b admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:12.600700 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 609/1189] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Apr 29 20:18:12 2022] PUT /identity/v3/projects/36d941262045404dac060112b011799e/users/2d9985747f4f4440a34f39f5bc24e084/roles/5255ed3fa613448fb4c549f5bc7f20af => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 20:18:12.612164 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 581/1190] 10.222.0.58 () {60 vars in 1482 bytes} [Fri Apr 29 20:18:12 2022] PUT /identity/v3/projects/01ea80582407497ab01903fda3ec18a6/users/3b019ab794c348bb917fdf0dc7aea8e4/roles/5255ed3fa613448fb4c549f5bc7f20af => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:18:20.763338 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb26c15-5740-454d-a82f-0de4ca6dcb8e None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:20.763848 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb26c15-5740-454d-a82f-0de4ca6dcb8e None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:20.764783 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb26c15-5740-454d-a82f-0de4ca6dcb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:20.801051 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-fbb26c15-5740-454d-a82f-0de4ca6dcb8e None None] MFA Rules not processed for user `2d9985747f4f4440a34f39f5bc24e084`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:20.802262 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-fbb26c15-5740-454d-a82f-0de4ca6dcb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:20.886357 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 610/1191] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:18:20 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:18:20.902424 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fc95c-66f5-418e-9d3a-f1d24640974b admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:20.909359 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-bb5fc95c-66f5-418e-9d3a-f1d24640974b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:20.994401 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fc95c-66f5-418e-9d3a-f1d24640974b admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:20.998545 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897c65-d216-44c7-a156-7b8f17821b80 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685208fceb044edb9970003b5225f3ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:20.999520 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897c65-d216-44c7-a156-7b8f17821b80 service glance] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:21.000563 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897c65-d216-44c7-a156-7b8f17821b80 service glance] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:21.001055 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897c65-d216-44c7-a156-7b8f17821b80 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:21.077673 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab897c65-d216-44c7-a156-7b8f17821b80 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:21.079276 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab897c65-d216-44c7-a156-7b8f17821b80 service glance] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:21.089002 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 582/1192] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:18:20 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:18:21.161399 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b25c4-4c28-437c-b88e-3b830133eca8 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:21.161681 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b25c4-4c28-437c-b88e-3b830133eca8 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:21.161953 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b25c4-4c28-437c-b88e-3b830133eca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:21.190753 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-448b25c4-4c28-437c-b88e-3b830133eca8 None None] MFA Rules not processed for user `3b019ab794c348bb917fdf0dc7aea8e4`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:21.192027 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-448b25c4-4c28-437c-b88e-3b830133eca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:21.300842 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 611/1193] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:18:21 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:18:21.313397 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897c65-d216-44c7-a156-7b8f17821b80 service glance] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:21.321677 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897c65-d216-44c7-a156-7b8f17821b80 service glance] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:21.325392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ebe79-b6d7-4edb-a157-84fa8a1f37db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685208fceb044edb9970003b5225f3ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:21.326030 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ebe79-b6d7-4edb-a157-84fa8a1f37db service glance] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:21.326308 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ebe79-b6d7-4edb-a157-84fa8a1f37db service glance] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:21.326580 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ebe79-b6d7-4edb-a157-84fa8a1f37db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:21.415782 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ebe79-b6d7-4edb-a157-84fa8a1f37db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:21.417539 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ebe79-b6d7-4edb-a157-84fa8a1f37db service glance] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:21.427160 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 583/1194] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:18:21 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:18:31.111121 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9422242-d8c3-47b3-844b-e05b350ef3f3 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:31.111651 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9422242-d8c3-47b3-844b-e05b350ef3f3 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:31.111651 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9422242-d8c3-47b3-844b-e05b350ef3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:31.131513 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-a9422242-d8c3-47b3-844b-e05b350ef3f3 None None] MFA Rules not processed for user `0cc61b0e25924d37b2f6e6f225f423d3`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:31.135102 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-a9422242-d8c3-47b3-844b-e05b350ef3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:31.147672 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 612/1195] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:18:31 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:18:31.447562 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1325cd-4a3d-45e2-9fd8-b4e2becaf486 None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:31.448113 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1325cd-4a3d-45e2-9fd8-b4e2becaf486 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:31.448207 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1325cd-4a3d-45e2-9fd8-b4e2becaf486 None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:31.449868 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 584/1196] 10.222.0.58 () {54 vars in 960 bytes} [Fri Apr 29 20:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:18:31.456104 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60bd5d-e3e6-44a5-9546-a109d2365c23 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:31.456388 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60bd5d-e3e6-44a5-9546-a109d2365c23 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:31.456662 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60bd5d-e3e6-44a5-9546-a109d2365c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:31.482099 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-8e60bd5d-e3e6-44a5-9546-a109d2365c23 None None] MFA Rules not processed for user `ca4e798ccd784e348136af337bf780f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:31.483870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-8e60bd5d-e3e6-44a5-9546-a109d2365c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:31.559097 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 613/1197] 10.222.0.58 () {58 vars in 1057 bytes} [Fri Apr 29 20:18:31 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:18:31.564922 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b95f9-0b76-4650-b733-37074f4981ed None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:31.565213 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b95f9-0b76-4650-b733-37074f4981ed None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:31.565486 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b95f9-0b76-4650-b733-37074f4981ed None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:31.566849 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 585/1198] 10.222.0.58 () {54 vars in 912 bytes} [Fri Apr 29 20:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:18:31.573365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85999115-5552-4767-8915-1ddb57e7dda6 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:31.573996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85999115-5552-4767-8915-1ddb57e7dda6 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:31.574471 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85999115-5552-4767-8915-1ddb57e7dda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:31.597128 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-85999115-5552-4767-8915-1ddb57e7dda6 None None] MFA Rules not processed for user `ca4e798ccd784e348136af337bf780f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:31.598623 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-85999115-5552-4767-8915-1ddb57e7dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:31.608056 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 614/1199] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Apr 29 20:18:31 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:18:31.621893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b95f9-0b76-4650-b733-37074f4981ed None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:31.623893 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-c27b95f9-0b76-4650-b733-37074f4981ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:31.640286 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b95f9-0b76-4650-b733-37074f4981ed None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:31.644515 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e4592-8525-4cda-b7d6-22ed1b55c6e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '685208fceb044edb9970003b5225f3ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:31.645196 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e4592-8525-4cda-b7d6-22ed1b55c6e5 service glance] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:31.645936 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e4592-8525-4cda-b7d6-22ed1b55c6e5 service glance] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:31.645936 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e4592-8525-4cda-b7d6-22ed1b55c6e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:31.656537 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e4592-8525-4cda-b7d6-22ed1b55c6e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:31.658542 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e4592-8525-4cda-b7d6-22ed1b55c6e5 service glance] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:31.669449 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 586/1200] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:18:31 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 20:18:32.025029 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7f70a-3694-46bf-ab3c-154a22276791 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:32.025390 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7f70a-3694-46bf-ab3c-154a22276791 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:32.025741 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7f70a-3694-46bf-ab3c-154a22276791 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:32.027269 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 615/1201] 10.222.0.58 () {54 vars in 912 bytes} [Fri Apr 29 20:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:18:32.032301 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202a4ff-fef1-417d-a4da-14ad2834f0d2 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:32.032561 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202a4ff-fef1-417d-a4da-14ad2834f0d2 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:32.032838 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202a4ff-fef1-417d-a4da-14ad2834f0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:32.051402 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-7202a4ff-fef1-417d-a4da-14ad2834f0d2 None None] MFA Rules not processed for user `a40ef0418f4a4bb7908e685d9f5d2966`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:32.052608 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-7202a4ff-fef1-417d-a4da-14ad2834f0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:32.107034 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 587/1202] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Apr 29 20:18:32 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:18:32.118634 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7f70a-3694-46bf-ab3c-154a22276791 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:32.130041 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7f70a-3694-46bf-ab3c-154a22276791 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:32.133588 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a77a63-0c2e-4b89-aacf-c3dc17226c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:32.134220 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a77a63-0c2e-4b89-aacf-c3dc17226c77 service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:32.134502 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a77a63-0c2e-4b89-aacf-c3dc17226c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:32.134775 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a77a63-0c2e-4b89-aacf-c3dc17226c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:32.142187 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a77a63-0c2e-4b89-aacf-c3dc17226c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:32.143647 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a77a63-0c2e-4b89-aacf-c3dc17226c77 service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:32.151299 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 616/1203] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:18:32 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:18:32.654167 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1aae5-3cef-4a23-8b7c-c2b3fa87460d None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:32.654736 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1aae5-3cef-4a23-8b7c-c2b3fa87460d None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:32.657048 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1aae5-3cef-4a23-8b7c-c2b3fa87460d None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:32.659869 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 588/1204] 10.222.0.58 () {54 vars in 960 bytes} [Fri Apr 29 20:18:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:18:32.663609 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923097d-e54d-4e71-a6ad-4810870f651d None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:32.664148 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923097d-e54d-4e71-a6ad-4810870f651d None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:32.664534 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923097d-e54d-4e71-a6ad-4810870f651d None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:32.666540 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 617/1205] 10.222.0.58 () {54 vars in 960 bytes} [Fri Apr 29 20:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:18:32.667309 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa1f74-a01b-413e-95d4-9b4c88e3f0a0 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:32.667595 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa1f74-a01b-413e-95d4-9b4c88e3f0a0 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:32.667876 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa1f74-a01b-413e-95d4-9b4c88e3f0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:32.674468 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399302a-4042-4e6f-b40d-96895883f8fe None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:32.674827 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399302a-4042-4e6f-b40d-96895883f8fe None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:32.675175 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399302a-4042-4e6f-b40d-96895883f8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:32.690537 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-60fa1f74-a01b-413e-95d4-9b4c88e3f0a0 None None] MFA Rules not processed for user `ca4e798ccd784e348136af337bf780f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:32.691778 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-60fa1f74-a01b-413e-95d4-9b4c88e3f0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:32.696578 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-7399302a-4042-4e6f-b40d-96895883f8fe None None] MFA Rules not processed for user `1d4caa8120a44bc79044e1459759ce4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:32.697838 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-7399302a-4042-4e6f-b40d-96895883f8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:32.706921 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 589/1206] 10.222.0.58 () {58 vars in 1057 bytes} [Fri Apr 29 20:18:32 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:18:32.712979 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3ae62-7160-47ee-95f3-83a85e4e3f4d None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:32.713387 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3ae62-7160-47ee-95f3-83a85e4e3f4d None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:32.713570 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3ae62-7160-47ee-95f3-83a85e4e3f4d None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:32.715029 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 590/1207] 10.222.0.58 () {54 vars in 912 bytes} [Fri Apr 29 20:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 29 20:18:32.720090 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd61dc9-cfe0-48aa-afca-035c39c5b935 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:32.720380 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd61dc9-cfe0-48aa-afca-035c39c5b935 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:32.721281 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd61dc9-cfe0-48aa-afca-035c39c5b935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:32.739760 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-8bd61dc9-cfe0-48aa-afca-035c39c5b935 None None] MFA Rules not processed for user `ca4e798ccd784e348136af337bf780f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:32.741243 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-8bd61dc9-cfe0-48aa-afca-035c39c5b935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:32.750211 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 591/1208] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Apr 29 20:18:32 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:18:32.761122 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd61dc9-cfe0-48aa-afca-035c39c5b935 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:32.765918 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 618/1209] 10.222.0.58 () {58 vars in 1057 bytes} [Fri Apr 29 20:18:32 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 29 20:18:32.773988 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399302a-4042-4e6f-b40d-96895883f8fe None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:32.776339 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd61dc9-cfe0-48aa-afca-035c39c5b935 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:32.780157 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8bd81-1f37-4415-9d43-d24fc218e5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:32.780802 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8bd81-1f37-4415-9d43-d24fc218e5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:32.781084 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8bd81-1f37-4415-9d43-d24fc218e5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:32.781359 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8bd81-1f37-4415-9d43-d24fc218e5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:32.787624 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399302a-4042-4e6f-b40d-96895883f8fe None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:32.792014 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8bd81-1f37-4415-9d43-d24fc218e5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:32.793451 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8bd81-1f37-4415-9d43-d24fc218e5c8 service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:32.794933 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5baad3-35b1-473e-a6a1-36b57173135a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4caa8120a44bc79044e1459759ce4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:32.795782 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5baad3-35b1-473e-a6a1-36b57173135a service placement] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:32.796101 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5baad3-35b1-473e-a6a1-36b57173135a service placement] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:32.796376 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5baad3-35b1-473e-a6a1-36b57173135a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:32.798231 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-1e5baad3-35b1-473e-a6a1-36b57173135a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:32.810395 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 592/1210] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:18:32 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:18:32.811319 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5baad3-35b1-473e-a6a1-36b57173135a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:32.812969 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5baad3-35b1-473e-a6a1-36b57173135a service placement] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:32.822840 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 619/1211] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:18:32 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 20:18:45.437804 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b991979-1f2e-4818-856f-a79c44018c73 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:45.446359 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b991979-1f2e-4818-856f-a79c44018c73 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:45.446359 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b991979-1f2e-4818-856f-a79c44018c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:45.457284 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-8b991979-1f2e-4818-856f-a79c44018c73 None None] MFA Rules not processed for user `a40ef0418f4a4bb7908e685d9f5d2966`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:45.458828 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-8b991979-1f2e-4818-856f-a79c44018c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:45.465350 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 593/1212] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Apr 29 20:18:45 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:18:45.477009 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5baad3-35b1-473e-a6a1-36b57173135a service placement] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:45.487340 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5baad3-35b1-473e-a6a1-36b57173135a service placement] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:45.491047 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28490d88-5afa-4523-84f9-8405261eafe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:45.491699 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28490d88-5afa-4523-84f9-8405261eafe2 service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:45.491999 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28490d88-5afa-4523-84f9-8405261eafe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:45.492358 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28490d88-5afa-4523-84f9-8405261eafe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:45.500354 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28490d88-5afa-4523-84f9-8405261eafe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:45.501786 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28490d88-5afa-4523-84f9-8405261eafe2 service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:45.510246 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 620/1213] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:18:45 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:18:46.428819 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785758f-147c-4b76-84da-3e8a5966095e None None] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:46.429110 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785758f-147c-4b76-84da-3e8a5966095e None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:46.429389 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785758f-147c-4b76-84da-3e8a5966095e None None] PATH_INFO: `/` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:46.430797 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 594/1214] 10.222.0.58 () {54 vars in 921 bytes} [Fri Apr 29 20:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:18:46.440770 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a4d62-0a43-47d4-b9b5-87514f036b92 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:46.440958 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a4d62-0a43-47d4-b9b5-87514f036b92 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:46.441270 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a4d62-0a43-47d4-b9b5-87514f036b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:46.481225 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-ab4a4d62-0a43-47d4-b9b5-87514f036b92 None None] MFA Rules not processed for user `ca4e798ccd784e348136af337bf780f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:46.482463 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-ab4a4d62-0a43-47d4-b9b5-87514f036b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:46.492214 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 621/1215] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Apr 29 20:18:46 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:18:46.554848 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785758f-147c-4b76-84da-3e8a5966095e None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:46.583676 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785758f-147c-4b76-84da-3e8a5966095e None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:46.597068 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f8d0f-91c9-4c34-909a-2b1d7d88611b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:46.597908 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f8d0f-91c9-4c34-909a-2b1d7d88611b service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:46.598195 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f8d0f-91c9-4c34-909a-2b1d7d88611b service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:46.598471 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f8d0f-91c9-4c34-909a-2b1d7d88611b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:46.610415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f8d0f-91c9-4c34-909a-2b1d7d88611b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:46.612614 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f8d0f-91c9-4c34-909a-2b1d7d88611b service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:46.622756 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 595/1216] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:18:46 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:18:54.093607 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fbb7f-88e8-488a-8f43-bb15980ef3ac None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:54.094805 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fbb7f-88e8-488a-8f43-bb15980ef3ac None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:54.095095 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fbb7f-88e8-488a-8f43-bb15980ef3ac None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:54.096872 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 622/1217] 10.222.0.58 () {54 vars in 921 bytes} [Fri Apr 29 20:18:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:18:54.108000 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb5e84-c013-43dc-94e0-a7ceff0d32c0 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:54.109077 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb5e84-c013-43dc-94e0-a7ceff0d32c0 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:54.110680 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb5e84-c013-43dc-94e0-a7ceff0d32c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:54.129903 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-65eb5e84-c013-43dc-94e0-a7ceff0d32c0 None None] MFA Rules not processed for user `ca4e798ccd784e348136af337bf780f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:18:54.143136 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-65eb5e84-c013-43dc-94e0-a7ceff0d32c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:18:54.143136 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 596/1218] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Apr 29 20:18:54 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:18:54.152880 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fbb7f-88e8-488a-8f43-bb15980ef3ac None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:18:54.166372 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fbb7f-88e8-488a-8f43-bb15980ef3ac None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:18:54.171534 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc3c70-67ee-4268-9361-aff9ad85ff90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:18:54.172207 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc3c70-67ee-4268-9361-aff9ad85ff90 service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:18:54.172589 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc3c70-67ee-4268-9361-aff9ad85ff90 service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:18:54.172864 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc3c70-67ee-4268-9361-aff9ad85ff90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:18:54.184343 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc3c70-67ee-4268-9361-aff9ad85ff90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:18:54.185955 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc3c70-67ee-4268-9361-aff9ad85ff90 service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:18:54.196359 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 623/1219] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:18:54 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:19:08.719343 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb5e84-c013-43dc-94e0-a7ceff0d32c0 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:19:08.729107 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb5e84-c013-43dc-94e0-a7ceff0d32c0 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:19:08.732753 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ddeb9-f345-447d-9f2a-38ea096586d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:19:08.733387 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ddeb9-f345-447d-9f2a-38ea096586d3 service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:19:08.733662 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ddeb9-f345-447d-9f2a-38ea096586d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:19:08.733932 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ddeb9-f345-447d-9f2a-38ea096586d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:19:08.742463 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ddeb9-f345-447d-9f2a-38ea096586d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:19:08.743875 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ddeb9-f345-447d-9f2a-38ea096586d3 service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:19:08.753105 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 597/1220] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:19:08 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:19:14.876280 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dc3f0-38bd-485d-ba3b-796349d59bc8 None None] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:19:14.876860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dc3f0-38bd-485d-ba3b-796349d59bc8 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:19:14.876860 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dc3f0-38bd-485d-ba3b-796349d59bc8 None None] PATH_INFO: `/` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:19:14.878182 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 624/1221] 10.222.0.58 () {54 vars in 921 bytes} [Fri Apr 29 20:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 29 20:19:14.895311 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ef1e7-4838-43c7-900a-5ffb61a2f57c None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:19:14.895948 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ef1e7-4838-43c7-900a-5ffb61a2f57c None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:19:14.895948 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ef1e7-4838-43c7-900a-5ffb61a2f57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:19:14.926504 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-710ef1e7-4838-43c7-900a-5ffb61a2f57c None None] MFA Rules not processed for user `ca4e798ccd784e348136af337bf780f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:19:14.927948 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-710ef1e7-4838-43c7-900a-5ffb61a2f57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:19:14.942825 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 598/1222] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Apr 29 20:19:14 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:19:14.963759 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dc3f0-38bd-485d-ba3b-796349d59bc8 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:19:14.983857 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dc3f0-38bd-485d-ba3b-796349d59bc8 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:19:15.001005 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840398f-3a14-4d20-9074-72f7928aaf52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:19:15.001683 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840398f-3a14-4d20-9074-72f7928aaf52 service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:19:15.001965 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840398f-3a14-4d20-9074-72f7928aaf52 service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:19:15.002241 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840398f-3a14-4d20-9074-72f7928aaf52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:19:15.020393 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840398f-3a14-4d20-9074-72f7928aaf52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:19:15.022046 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840398f-3a14-4d20-9074-72f7928aaf52 service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:19:15.033833 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 625/1223] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:19:14 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:20:14.737095 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfb0b9-048b-4727-b735-078bf0c79729 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:20:14.737563 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfb0b9-048b-4727-b735-078bf0c79729 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:20:14.737657 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfb0b9-048b-4727-b735-078bf0c79729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:20:14.763534 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-cdbfb0b9-048b-4727-b735-078bf0c79729 None None] MFA Rules not processed for user `982fa964e7b045f790055499f1787dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:20:14.764749 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-cdbfb0b9-048b-4727-b735-078bf0c79729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:20:14.791248 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 599/1224] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:20:14 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:20:51.297285 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8305a08-0188-470e-b7e2-2843fb1f9535 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:20:51.297744 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8305a08-0188-470e-b7e2-2843fb1f9535 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:20:51.297831 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8305a08-0188-470e-b7e2-2843fb1f9535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:20:51.315980 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-e8305a08-0188-470e-b7e2-2843fb1f9535 None None] MFA Rules not processed for user `982fa964e7b045f790055499f1787dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:20:51.317155 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-e8305a08-0188-470e-b7e2-2843fb1f9535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:20:51.324559 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 626/1225] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:20:51 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:21:09.190785 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecdefa-9a7d-4cad-9e54-bc58f418ed71 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:21:09.191189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecdefa-9a7d-4cad-9e54-bc58f418ed71 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:21:09.191189 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecdefa-9a7d-4cad-9e54-bc58f418ed71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:21:09.209103 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-f4ecdefa-9a7d-4cad-9e54-bc58f418ed71 None None] MFA Rules not processed for user `982fa964e7b045f790055499f1787dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:21:09.210291 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-f4ecdefa-9a7d-4cad-9e54-bc58f418ed71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:21:09.217033 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 600/1226] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:21:09 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:21:09.511457 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf3687-d605-4d38-9468-573c370681f9 None None] REQUEST_METHOD: `POST` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:21:09.511956 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf3687-d605-4d38-9468-573c370681f9 None None] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:21:09.512071 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf3687-d605-4d38-9468-573c370681f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:21:09.566005 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.auth.core [None req-e5bf3687-d605-4d38-9468-573c370681f9 None None] MFA Rules not processed for user `a40ef0418f4a4bb7908e685d9f5d2966`. Rule list: `[]` (Enabled: `True`). {{(pid=87059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:21:09.567197 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-e5bf3687-d605-4d38-9468-573c370681f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:21:09.596923 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 627/1227] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Apr 29 20:21:09 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:21:09.608471 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecdefa-9a7d-4cad-9e54-bc58f418ed71 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:21:09.617577 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecdefa-9a7d-4cad-9e54-bc58f418ed71 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:21:09.621086 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935c28e-4852-4e97-950f-8a5f68d228f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:21:09.621718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935c28e-4852-4e97-950f-8a5f68d228f6 service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:21:09.627711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935c28e-4852-4e97-950f-8a5f68d228f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:21:09.627711 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935c28e-4852-4e97-950f-8a5f68d228f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:21:09.629793 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935c28e-4852-4e97-950f-8a5f68d228f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:21:09.631279 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935c28e-4852-4e97-950f-8a5f68d228f6 service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:21:09.638816 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 601/1228] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:21:09 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:21:26.601386 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf3687-d605-4d38-9468-573c370681f9 None None] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:21:26.629970 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf3687-d605-4d38-9468-573c370681f9 None None] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:21:26.635025 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e7b0a-7664-44f6-ae29-521e5e81373c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4caa8120a44bc79044e1459759ce4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:21:26.635656 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7b0a-7664-44f6-ae29-521e5e81373c service placement] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:21:26.635937 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7b0a-7664-44f6-ae29-521e5e81373c service placement] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:21:26.636247 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7b0a-7664-44f6-ae29-521e5e81373c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:21:26.644605 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e7b0a-7664-44f6-ae29-521e5e81373c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:21:26.646219 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e7b0a-7664-44f6-ae29-521e5e81373c service placement] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:21:26.655646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 628/1229] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:21:26 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:21:47.871343 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935c28e-4852-4e97-950f-8a5f68d228f6 service neutron] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:21:47.951740 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935c28e-4852-4e97-950f-8a5f68d228f6 service neutron] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:21:47.956275 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780cefc-55d9-4559-a249-676f3efbe3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:21:47.957387 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780cefc-55d9-4559-a249-676f3efbe3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:21:47.957659 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780cefc-55d9-4559-a249-676f3efbe3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:21:47.958022 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780cefc-55d9-4559-a249-676f3efbe3c5 admin admin] PATH_INFO: `/v3/users/0cc61b0e25924d37b2f6e6f225f423d3` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:21:47.959218 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780cefc-55d9-4559-a249-676f3efbe3c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc61b0e25924d37b2f6e6f225f423d3)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:21:47.961274 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780cefc-55d9-4559-a249-676f3efbe3c5 admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:21:48.128547 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-3780cefc-55d9-4559-a249-676f3efbe3c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc61b0e25924d37b2f6e6f225f423d3'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:48.189028 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-3780cefc-55d9-4559-a249-676f3efbe3c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc61b0e25924d37b2f6e6f225f423d3'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:48.200715 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-3780cefc-55d9-4559-a249-676f3efbe3c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc61b0e25924d37b2f6e6f225f423d3'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:48.207643 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-3780cefc-55d9-4559-a249-676f3efbe3c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc61b0e25924d37b2f6e6f225f423d3'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:48.208303 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-3780cefc-55d9-4559-a249-676f3efbe3c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc61b0e25924d37b2f6e6f225f423d3'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:48.214465 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 602/1230] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Apr 29 20:21:47 2022] DELETE /identity/v3/users/0cc61b0e25924d37b2f6e6f225f423d3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:21:48.458108 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e7b0a-7664-44f6-ae29-521e5e81373c service placement] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:21:48.470803 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e7b0a-7664-44f6-ae29-521e5e81373c service placement] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:21:48.525568 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59beabd-9521-4969-8626-0545a5a8015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:21:48.526430 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59beabd-9521-4969-8626-0545a5a8015b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:21:48.526707 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59beabd-9521-4969-8626-0545a5a8015b admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:21:48.526984 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59beabd-9521-4969-8626-0545a5a8015b admin admin] PATH_INFO: `/v3/projects/751ecce457bd4fa2872d2f9463d48a16` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:21:48.528192 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59beabd-9521-4969-8626-0545a5a8015b admin admin] RBAC: Authorizing `identity:delete_project(project_id=751ecce457bd4fa2872d2f9463d48a16)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:21:48.530102 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59beabd-9521-4969-8626-0545a5a8015b admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:21:48.730209 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-f59beabd-9521-4969-8626-0545a5a8015b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '751ecce457bd4fa2872d2f9463d48a16', 'request_id': 'req-f59beabd-9521-4969-8626-0545a5a8015b'} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:48.736163 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-f59beabd-9521-4969-8626-0545a5a8015b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '751ecce457bd4fa2872d2f9463d48a16', 'request_id': 'req-f59beabd-9521-4969-8626-0545a5a8015b'} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:48.741308 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-f59beabd-9521-4969-8626-0545a5a8015b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '751ecce457bd4fa2872d2f9463d48a16', 'request_id': 'req-f59beabd-9521-4969-8626-0545a5a8015b'} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:48.848456 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-f59beabd-9521-4969-8626-0545a5a8015b admin admin] The token cache is being invalidate because project 751ecce457bd4fa2872d2f9463d48a16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 20:21:48.848739 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-f59beabd-9521-4969-8626-0545a5a8015b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:48.849368 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-f59beabd-9521-4969-8626-0545a5a8015b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:48.850903 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 629/1231] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Apr 29 20:21:48 2022] DELETE /identity/v3/projects/751ecce457bd4fa2872d2f9463d48a16 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:21:48.854949 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780cefc-55d9-4559-a249-676f3efbe3c5 admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:21:48.856528 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-3780cefc-55d9-4559-a249-676f3efbe3c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:21:48.869735 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780cefc-55d9-4559-a249-676f3efbe3c5 admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:21:48.943658 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97719f88-8aab-4e00-b622-104d5e70d300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:21:48.954630 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97719f88-8aab-4e00-b622-104d5e70d300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:21:48.954630 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97719f88-8aab-4e00-b622-104d5e70d300 admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:21:48.954630 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97719f88-8aab-4e00-b622-104d5e70d300 admin admin] PATH_INFO: `/v3/users/2d9985747f4f4440a34f39f5bc24e084` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:21:48.954630 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97719f88-8aab-4e00-b622-104d5e70d300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9985747f4f4440a34f39f5bc24e084)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:21:48.954630 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97719f88-8aab-4e00-b622-104d5e70d300 admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:21:49.157548 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-97719f88-8aab-4e00-b622-104d5e70d300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9985747f4f4440a34f39f5bc24e084'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:49.247155 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-97719f88-8aab-4e00-b622-104d5e70d300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9985747f4f4440a34f39f5bc24e084'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:49.259808 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-97719f88-8aab-4e00-b622-104d5e70d300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9985747f4f4440a34f39f5bc24e084'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:49.266203 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-97719f88-8aab-4e00-b622-104d5e70d300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9985747f4f4440a34f39f5bc24e084'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:49.266839 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-97719f88-8aab-4e00-b622-104d5e70d300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9985747f4f4440a34f39f5bc24e084'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:49.272544 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 603/1232] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Apr 29 20:21:48 2022] DELETE /identity/v3/users/2d9985747f4f4440a34f39f5bc24e084 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 29 20:21:49.563001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59beabd-9521-4969-8626-0545a5a8015b admin admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:21:49.564601 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-f59beabd-9521-4969-8626-0545a5a8015b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:21:49.579066 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59beabd-9521-4969-8626-0545a5a8015b admin admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:21:49.636033 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0df464-9e51-4d2c-badc-e2832c9b46f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:21:49.636900 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0df464-9e51-4d2c-badc-e2832c9b46f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:21:49.637182 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0df464-9e51-4d2c-badc-e2832c9b46f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:21:49.637457 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0df464-9e51-4d2c-badc-e2832c9b46f3 admin admin] PATH_INFO: `/v3/projects/36d941262045404dac060112b011799e` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:21:49.638635 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0df464-9e51-4d2c-badc-e2832c9b46f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d941262045404dac060112b011799e)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:21:49.640675 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0df464-9e51-4d2c-badc-e2832c9b46f3 admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:21:49.773205 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-8e0df464-9e51-4d2c-badc-e2832c9b46f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d941262045404dac060112b011799e', 'request_id': 'req-8e0df464-9e51-4d2c-badc-e2832c9b46f3'} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:49.779125 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-8e0df464-9e51-4d2c-badc-e2832c9b46f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d941262045404dac060112b011799e', 'request_id': 'req-8e0df464-9e51-4d2c-badc-e2832c9b46f3'} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:49.784349 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-8e0df464-9e51-4d2c-badc-e2832c9b46f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d941262045404dac060112b011799e', 'request_id': 'req-8e0df464-9e51-4d2c-badc-e2832c9b46f3'} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:49.840082 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-8e0df464-9e51-4d2c-badc-e2832c9b46f3 admin admin] The token cache is being invalidate because project 36d941262045404dac060112b011799e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 20:21:49.840901 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-8e0df464-9e51-4d2c-badc-e2832c9b46f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:49.840996 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-8e0df464-9e51-4d2c-badc-e2832c9b46f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:21:49.842504 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 630/1233] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Apr 29 20:21:49 2022] DELETE /identity/v3/projects/36d941262045404dac060112b011799e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:22:30.001824 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c39e0-2536-4cb2-963d-92f24abb52a6 None None] REQUEST_METHOD: `POST` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:22:30.002306 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c39e0-2536-4cb2-963d-92f24abb52a6 None None] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:22:30.002392 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c39e0-2536-4cb2-963d-92f24abb52a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:22:30.019905 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.auth.core [None req-452c39e0-2536-4cb2-963d-92f24abb52a6 None None] MFA Rules not processed for user `982fa964e7b045f790055499f1787dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=87060) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 29 20:22:30.021141 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-452c39e0-2536-4cb2-963d-92f24abb52a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:22:30.071666 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 604/1234] 10.222.0.58 () {58 vars in 957 bytes} [Fri Apr 29 20:22:30 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 29 20:22:44.064125 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0df464-9e51-4d2c-badc-e2832c9b46f3 admin admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:22:44.065558 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-8e0df464-9e51-4d2c-badc-e2832c9b46f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:22:44.121777 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0df464-9e51-4d2c-badc-e2832c9b46f3 admin admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:22:44.125388 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e0888-aa0d-4dd2-a4be-4974399c3a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:22:44.126033 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e0888-aa0d-4dd2-a4be-4974399c3a80 service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:22:44.126312 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e0888-aa0d-4dd2-a4be-4974399c3a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:22:44.126588 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e0888-aa0d-4dd2-a4be-4974399c3a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:22:44.128421 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-f46e0888-aa0d-4dd2-a4be-4974399c3a80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:22:44.189232 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e0888-aa0d-4dd2-a4be-4974399c3a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:22:44.190668 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e0888-aa0d-4dd2-a4be-4974399c3a80 service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:22:44.200001 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 631/1235] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:22:44 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:24:26.681646 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c39e0-2536-4cb2-963d-92f24abb52a6 None None] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:24:26.691451 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c39e0-2536-4cb2-963d-92f24abb52a6 None None] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:24:26.695177 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e49e9a-fce7-47ce-a805-c0372e3aca1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:24:26.695812 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e49e9a-fce7-47ce-a805-c0372e3aca1b service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:24:26.696133 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e49e9a-fce7-47ce-a805-c0372e3aca1b service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:24:26.696406 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e49e9a-fce7-47ce-a805-c0372e3aca1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:24:26.698161 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-15e49e9a-fce7-47ce-a805-c0372e3aca1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:24:26.707748 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e49e9a-fce7-47ce-a805-c0372e3aca1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:24:26.709377 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e49e9a-fce7-47ce-a805-c0372e3aca1b service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:24:26.716990 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 605/1236] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:24:26 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:26:03.864533 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e0888-aa0d-4dd2-a4be-4974399c3a80 service neutron] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:26:03.866118 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-f46e0888-aa0d-4dd2-a4be-4974399c3a80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:26:03.951834 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e0888-aa0d-4dd2-a4be-4974399c3a80 service neutron] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:26:03.958084 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d9a3b-e963-44e1-82fe-548b7bf17c29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:26:03.958727 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d9a3b-e963-44e1-82fe-548b7bf17c29 service nova] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:26:03.959005 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d9a3b-e963-44e1-82fe-548b7bf17c29 service nova] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:26:03.959281 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d9a3b-e963-44e1-82fe-548b7bf17c29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:26:03.961324 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-5c3d9a3b-e963-44e1-82fe-548b7bf17c29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:26:03.971597 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d9a3b-e963-44e1-82fe-548b7bf17c29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:26:03.977365 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d9a3b-e963-44e1-82fe-548b7bf17c29 service nova] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:26:03.981846 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 632/1237] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:26:03 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:26:06.098761 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e49e9a-fce7-47ce-a805-c0372e3aca1b service neutron] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:26:06.109845 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e49e9a-fce7-47ce-a805-c0372e3aca1b service neutron] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:26:06.115479 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e2ab9-14ff-498b-bdd0-86f68523cdf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca4e798ccd784e348136af337bf780f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:26:06.116254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e2ab9-14ff-498b-bdd0-86f68523cdf6 service nova] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:26:06.116610 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e2ab9-14ff-498b-bdd0-86f68523cdf6 service nova] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:26:06.117436 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e2ab9-14ff-498b-bdd0-86f68523cdf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:26:06.118796 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-cc7e2ab9-14ff-498b-bdd0-86f68523cdf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:26:06.131496 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e2ab9-14ff-498b-bdd0-86f68523cdf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:26:06.133344 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e2ab9-14ff-498b-bdd0-86f68523cdf6 service nova] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:26:06.143345 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 606/1238] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:26:06 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 29 20:26:06.485402 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d9a3b-e963-44e1-82fe-548b7bf17c29 service nova] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:26:06.496268 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d9a3b-e963-44e1-82fe-548b7bf17c29 service nova] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:26:06.500130 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403c6dc-04e2-40bf-bc2b-ff5fe9eedb21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:26:06.500768 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403c6dc-04e2-40bf-bc2b-ff5fe9eedb21 service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:26:06.501076 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403c6dc-04e2-40bf-bc2b-ff5fe9eedb21 service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:26:06.501343 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403c6dc-04e2-40bf-bc2b-ff5fe9eedb21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:26:06.503556 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-c403c6dc-04e2-40bf-bc2b-ff5fe9eedb21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:26:06.516288 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403c6dc-04e2-40bf-bc2b-ff5fe9eedb21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:26:06.518302 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403c6dc-04e2-40bf-bc2b-ff5fe9eedb21 service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:26:06.529636 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 633/1239] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:26:06 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:26:07.709788 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e2ab9-14ff-498b-bdd0-86f68523cdf6 service nova] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:26:07.711254 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-cc7e2ab9-14ff-498b-bdd0-86f68523cdf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:26:07.736802 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e2ab9-14ff-498b-bdd0-86f68523cdf6 service nova] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:26:07.740388 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a1116-2935-4b82-8d4e-56b93dedda44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:26:07.741041 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a1116-2935-4b82-8d4e-56b93dedda44 service neutron] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:26:07.741325 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a1116-2935-4b82-8d4e-56b93dedda44 service neutron] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:26:07.741601 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a1116-2935-4b82-8d4e-56b93dedda44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:26:07.743463 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-075a1116-2935-4b82-8d4e-56b93dedda44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:26:07.756214 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a1116-2935-4b82-8d4e-56b93dedda44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:26:07.757639 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a1116-2935-4b82-8d4e-56b93dedda44 service neutron] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:26:07.767415 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 607/1240] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:26:07 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:26:16.857928 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403c6dc-04e2-40bf-bc2b-ff5fe9eedb21 service neutron] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:26:16.867015 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403c6dc-04e2-40bf-bc2b-ff5fe9eedb21 service neutron] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:26:16.870613 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2ef55-40a2-4472-a3e7-bd6a22ba8c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a40ef0418f4a4bb7908e685d9f5d2966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:26:16.871245 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2ef55-40a2-4472-a3e7-bd6a22ba8c0d service neutron] REQUEST_METHOD: `GET` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:26:16.871527 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2ef55-40a2-4472-a3e7-bd6a22ba8c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:26:16.871803 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2ef55-40a2-4472-a3e7-bd6a22ba8c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:26:16.873555 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-b6a2ef55-40a2-4472-a3e7-bd6a22ba8c0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:26:16.934595 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2ef55-40a2-4472-a3e7-bd6a22ba8c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:26:16.936353 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2ef55-40a2-4472-a3e7-bd6a22ba8c0d service neutron] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:26:16.946140 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 634/1241] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:26:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 29 20:26:24.323026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a1116-2935-4b82-8d4e-56b93dedda44 service neutron] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:26:24.323026 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-075a1116-2935-4b82-8d4e-56b93dedda44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:26:24.333328 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a1116-2935-4b82-8d4e-56b93dedda44 service neutron] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:26:24.337902 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bed75d-bce7-4d7e-8ed2-8c4b6da3bbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:26:24.338765 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bed75d-bce7-4d7e-8ed2-8c4b6da3bbfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:26:24.339070 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bed75d-bce7-4d7e-8ed2-8c4b6da3bbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:26:24.339341 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bed75d-bce7-4d7e-8ed2-8c4b6da3bbfe admin admin] PATH_INFO: `/v3/users/982fa964e7b045f790055499f1787dfd` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:26:24.340542 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bed75d-bce7-4d7e-8ed2-8c4b6da3bbfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=982fa964e7b045f790055499f1787dfd)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:26:24.342474 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bed75d-bce7-4d7e-8ed2-8c4b6da3bbfe admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:26:24.545094 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-94bed75d-bce7-4d7e-8ed2-8c4b6da3bbfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982fa964e7b045f790055499f1787dfd'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:24.629029 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-94bed75d-bce7-4d7e-8ed2-8c4b6da3bbfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982fa964e7b045f790055499f1787dfd'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:24.640796 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-94bed75d-bce7-4d7e-8ed2-8c4b6da3bbfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982fa964e7b045f790055499f1787dfd'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:24.647322 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-94bed75d-bce7-4d7e-8ed2-8c4b6da3bbfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982fa964e7b045f790055499f1787dfd'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:24.647964 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-94bed75d-bce7-4d7e-8ed2-8c4b6da3bbfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982fa964e7b045f790055499f1787dfd'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:24.653669 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 608/1242] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Apr 29 20:26:24 2022] DELETE /identity/v3/users/982fa964e7b045f790055499f1787dfd => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:26:24.905342 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2ef55-40a2-4472-a3e7-bd6a22ba8c0d service neutron] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:26:24.915709 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2ef55-40a2-4472-a3e7-bd6a22ba8c0d service neutron] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:26:24.970015 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9870d5-99bd-4e05-a277-f53d9a27d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:26:24.970870 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9870d5-99bd-4e05-a277-f53d9a27d06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:26:24.971147 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9870d5-99bd-4e05-a277-f53d9a27d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:26:24.971417 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9870d5-99bd-4e05-a277-f53d9a27d06f admin admin] PATH_INFO: `/v3/projects/d326466543374fae8e7be5f60de02ed5` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:26:24.972618 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9870d5-99bd-4e05-a277-f53d9a27d06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d326466543374fae8e7be5f60de02ed5)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:26:24.974551 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9870d5-99bd-4e05-a277-f53d9a27d06f admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:26:25.073554 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-4f9870d5-99bd-4e05-a277-f53d9a27d06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd326466543374fae8e7be5f60de02ed5', 'request_id': 'req-4f9870d5-99bd-4e05-a277-f53d9a27d06f'} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:25.079675 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-4f9870d5-99bd-4e05-a277-f53d9a27d06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd326466543374fae8e7be5f60de02ed5', 'request_id': 'req-4f9870d5-99bd-4e05-a277-f53d9a27d06f'} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:25.085607 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-4f9870d5-99bd-4e05-a277-f53d9a27d06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd326466543374fae8e7be5f60de02ed5', 'request_id': 'req-4f9870d5-99bd-4e05-a277-f53d9a27d06f'} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:25.150286 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-4f9870d5-99bd-4e05-a277-f53d9a27d06f admin admin] The token cache is being invalidate because project d326466543374fae8e7be5f60de02ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 20:26:25.150501 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-4f9870d5-99bd-4e05-a277-f53d9a27d06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:25.151128 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-4f9870d5-99bd-4e05-a277-f53d9a27d06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:25.152712 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 635/1243] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Apr 29 20:26:24 2022] DELETE /identity/v3/projects/d326466543374fae8e7be5f60de02ed5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:26:25.156739 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bed75d-bce7-4d7e-8ed2-8c4b6da3bbfe admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:26:25.158152 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-94bed75d-bce7-4d7e-8ed2-8c4b6da3bbfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:26:25.171456 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bed75d-bce7-4d7e-8ed2-8c4b6da3bbfe admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:26:25.225271 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cd83b-d9ea-400b-9221-ad85ca7e2400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:26:25.226718 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cd83b-d9ea-400b-9221-ad85ca7e2400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:26:25.227148 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cd83b-d9ea-400b-9221-ad85ca7e2400 admin admin] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:26:25.227637 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cd83b-d9ea-400b-9221-ad85ca7e2400 admin admin] PATH_INFO: `/v3/users/3b019ab794c348bb917fdf0dc7aea8e4` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:26:25.229684 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cd83b-d9ea-400b-9221-ad85ca7e2400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b019ab794c348bb917fdf0dc7aea8e4)` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:26:25.232752 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cd83b-d9ea-400b-9221-ad85ca7e2400 admin admin] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:26:25.426724 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-9e8cd83b-d9ea-400b-9221-ad85ca7e2400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b019ab794c348bb917fdf0dc7aea8e4'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:25.533362 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-9e8cd83b-d9ea-400b-9221-ad85ca7e2400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b019ab794c348bb917fdf0dc7aea8e4'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:25.545205 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-9e8cd83b-d9ea-400b-9221-ad85ca7e2400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b019ab794c348bb917fdf0dc7aea8e4'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:25.551708 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-9e8cd83b-d9ea-400b-9221-ad85ca7e2400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b019ab794c348bb917fdf0dc7aea8e4'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:25.552349 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.notifications [None req-9e8cd83b-d9ea-400b-9221-ad85ca7e2400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b019ab794c348bb917fdf0dc7aea8e4'} {{(pid=87060) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:25.558506 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 609/1244] 10.222.0.58 () {58 vars in 1223 bytes} [Fri Apr 29 20:26:25 2022] DELETE /identity/v3/users/3b019ab794c348bb917fdf0dc7aea8e4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:26:25.814885 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9870d5-99bd-4e05-a277-f53d9a27d06f admin admin] Authenticating user token {{(pid=87059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:26:25.816353 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.fernet_utils [None req-4f9870d5-99bd-4e05-a277-f53d9a27d06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:26:25.830759 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9870d5-99bd-4e05-a277-f53d9a27d06f admin admin] Validating token access rules against request {{(pid=87059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:26:25.885256 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d1335-e9fe-478e-aca5-a654d5d06b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60cf68d8163c4e1192fe62342bc80660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e417b1278554b3d876c18d3b8c537fa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:26:25.886106 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d1335-e9fe-478e-aca5-a654d5d06b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:26:25.886382 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d1335-e9fe-478e-aca5-a654d5d06b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:26:25.886649 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d1335-e9fe-478e-aca5-a654d5d06b59 admin admin] PATH_INFO: `/v3/projects/01ea80582407497ab01903fda3ec18a6` {{(pid=87059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:26:25.887797 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d1335-e9fe-478e-aca5-a654d5d06b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ea80582407497ab01903fda3ec18a6)` {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:26:25.889736 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d1335-e9fe-478e-aca5-a654d5d06b59 admin admin] RBAC: Authorization granted {{(pid=87059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:26:26.022493 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-2b9d1335-e9fe-478e-aca5-a654d5d06b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ea80582407497ab01903fda3ec18a6', 'request_id': 'req-2b9d1335-e9fe-478e-aca5-a654d5d06b59'} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:26.028305 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-2b9d1335-e9fe-478e-aca5-a654d5d06b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ea80582407497ab01903fda3ec18a6', 'request_id': 'req-2b9d1335-e9fe-478e-aca5-a654d5d06b59'} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:26.033542 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-2b9d1335-e9fe-478e-aca5-a654d5d06b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ea80582407497ab01903fda3ec18a6', 'request_id': 'req-2b9d1335-e9fe-478e-aca5-a654d5d06b59'} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:26.102749 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-2b9d1335-e9fe-478e-aca5-a654d5d06b59 admin admin] The token cache is being invalidate because project 01ea80582407497ab01903fda3ec18a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 29 20:26:26.103033 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-2b9d1335-e9fe-478e-aca5-a654d5d06b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:26.103646 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: DEBUG keystone.notifications [None req-2b9d1335-e9fe-478e-aca5-a654d5d06b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 29 20:26:26.105205 dv-osbrick-836391-8-ceph devstack@keystone.service[87059]: [pid: 87059|app: 0|req: 636/1245] 10.222.0.58 () {58 vars in 1232 bytes} [Fri Apr 29 20:26:25 2022] DELETE /identity/v3/projects/01ea80582407497ab01903fda3ec18a6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 29 20:26:32.921231 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cd83b-d9ea-400b-9221-ad85ca7e2400 admin admin] Authenticating user token {{(pid=87060) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 29 20:26:32.922754 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-9e8cd83b-d9ea-400b-9221-ad85ca7e2400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:26:33.000261 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cd83b-d9ea-400b-9221-ad85ca7e2400 admin admin] Validating token access rules against request {{(pid=87060) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 29 20:26:33.055675 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfd885-ec39-4f38-a94d-a72ebc94ffba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d4caa8120a44bc79044e1459759ce4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd13e73e4e3bf4143b30c02ccf7e1a13c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87060) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 29 20:26:33.056351 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfd885-ec39-4f38-a94d-a72ebc94ffba service placement] REQUEST_METHOD: `GET` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 29 20:26:33.056642 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfd885-ec39-4f38-a94d-a72ebc94ffba service placement] SCRIPT_NAME: `/identity` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 29 20:26:33.056918 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfd885-ec39-4f38-a94d-a72ebc94ffba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87060) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 29 20:26:33.058655 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.fernet_utils [None req-2ddfd885-ec39-4f38-a94d-a72ebc94ffba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87060) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 29 20:26:33.069343 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfd885-ec39-4f38-a94d-a72ebc94ffba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 29 20:26:33.070953 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfd885-ec39-4f38-a94d-a72ebc94ffba service placement] RBAC: Authorization granted {{(pid=87060) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 29 20:26:33.080590 dv-osbrick-836391-8-ceph devstack@keystone.service[87060]: [pid: 87060|app: 0|req: 610/1246] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Apr 29 20:26:32 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)